-- Logs begin at Wed 2022-01-05 17:11:04 UTC, end at Wed 2022-01-05 18:29:25 UTC. -- Jan 05 17:57:46.265806 dv-cinder-xena-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 05 17:57:46.273175 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 5 17:57:46 2022] *** Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: nodename: dv-cinder-xena-3-iscsi Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: machine: x86_64 Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: clock source: unix Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: pcre jit disabled Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: detected number of CPU cores: 4 Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: current working directory: / Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: detected binary path: /usr/bin/uwsgi-core Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: your processes number limit is 47680 Jan 05 17:57:46.277104 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: your memory page size is 4096 bytes Jan 05 17:57:46.277947 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: detected max file descriptor number: 2048 Jan 05 17:57:46.277947 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: lock engine: pthread robust mutexes Jan 05 17:57:46.277947 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: thunder lock: enabled Jan 05 17:57:46.277947 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 05 17:57:46.277947 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 05 17:57:46.320571 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: Python main interpreter initialized at 0x5570a279f9c0 Jan 05 17:57:46.320571 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: python threads support enabled Jan 05 17:57:46.320571 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: your server socket listen backlog is limited to 100 connections Jan 05 17:57:46.320571 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: your mercy for graceful operations on workers is 90 seconds Jan 05 17:57:46.320926 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: mapped 403077 bytes (393 KB) for 2 cores Jan 05 17:57:46.321002 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: *** Operational MODE: preforking *** Jan 05 17:57:46.321233 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: *** uWSGI is running in multiple interpreter mode *** Jan 05 17:57:46.321233 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: spawned uWSGI master process (pid: 101358) Jan 05 17:57:46.321432 dv-cinder-xena-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 05 17:57:46.322836 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: spawned uWSGI worker 1 (pid: 101359, cores: 1) Jan 05 17:57:46.322836 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: spawned uWSGI worker 2 (pid: 101360, cores: 1) Jan 05 17:57:46.323081 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 05 17:57:47.965062 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 17:57:47.965062 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: from cryptography.utils import int_from_bytes Jan 05 17:57:47.965708 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 17:57:47.965708 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: from cryptography.utils import int_from_bytes Jan 05 17:57:47.968868 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 17:57:47.968868 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: from cryptography.utils import int_from_bytes Jan 05 17:57:47.969355 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 17:57:47.969355 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: from cryptography.utils import int_from_bytes Jan 05 17:57:50.665359 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 17:57:50.666460 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 17:57:50.666830 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 17:57:50.667199 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 17:57:50.667454 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 17:57:50.667828 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 17:57:50.668213 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.668310 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 17:57:50.668398 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.668476 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.668550 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 17:57:50.668757 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.668877 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 17:57:50.669084 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.669171 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 17:57:50.669392 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.669500 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.669711 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.669824 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670049 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670149 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670377 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670462 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670635 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670782 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.670947 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671098 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671271 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-xena-3-iscsi {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671409 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671587 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671724 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.671891 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672047 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672198 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672292 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672514 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672599 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672816 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.672902 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-xena-3-iscsi {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673138 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673239 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673439 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673607 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673799 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.673936 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.674147 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.674400 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.674534 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.674700 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.674869 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675007 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675133 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675344 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675532 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675656 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675841 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.675959 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676145 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676266 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676450 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676543 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676783 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.676882 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677090 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677182 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677395 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677544 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-xena-3-iscsi {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677711 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.677858 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678034 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678207 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678363 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678519 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678670 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.678929 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679058 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-xena-3-iscsi {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679369 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679543 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679677 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679861 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.679987 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.680183 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.680395 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.680488 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.680705 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.680792 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.681013 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.681099 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682091 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682313 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682471 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682605 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682741 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682861 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.682973 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683079 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683277 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683392 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683653 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683776 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.683891 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684003 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684194 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684307 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684437 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684618 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684731 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.684853 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685043 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685171 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685363 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685494 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685665 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685804 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.685939 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686097 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686231 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686355 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686486 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686609 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686799 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.686938 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687110 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687237 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687370 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687493 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687614 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687744 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.687914 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688050 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688230 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688358 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688538 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688671 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688844 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.688943 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689149 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689235 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689457 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689570 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689764 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.689873 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690090 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690189 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690396 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690489 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690701 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.690803 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691016 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691104 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691341 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691480 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691631 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691719 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.691932 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692026 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692246 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692332 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692558 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692643 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692872 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.692957 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693175 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693259 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693483 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693569 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693790 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.693888 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694119 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694222 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694434 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694528 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694754 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.694848 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695055 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695148 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695300 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695385 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695598 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695683 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.695900 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696000 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696215 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696301 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696520 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696612 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696776 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.696906 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697217 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697385 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697543 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697643 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697816 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.697904 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698144 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698266 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698452 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698543 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698755 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.698842 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699053 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699153 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699353 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699439 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699656 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699754 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.699956 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700050 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700257 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700341 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700561 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700648 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700861 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.700946 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701164 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701249 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701465 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701603 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701763 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.701849 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702095 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702198 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702410 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702506 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702712 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.702810 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703014 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703098 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703315 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703403 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703620 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703703 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.703924 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704018 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704223 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704315 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704525 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704610 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704826 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.704911 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705131 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705224 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705426 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705509 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705730 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.705825 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706078 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706168 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706355 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706440 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706657 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706758 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.706953 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707037 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707255 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707347 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707554 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707646 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707858 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.707944 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708156 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708240 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708454 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708595 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708764 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.708896 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709046 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709131 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709347 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709434 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709688 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709832 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.709942 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710043 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710262 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710350 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710574 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710666 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710890 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.710976 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.711195 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.711289 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.711499 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.711591 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.711801 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.711889 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.712114 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 17:57:50.712201 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.712559 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.712938 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.713108 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.713394 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.713483 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.713738 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.713880 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.714076 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.714398 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.714503 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.714730 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.714900 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715047 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715224 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715357 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715541 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715670 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715864 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.715991 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716187 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716284 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716516 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716609 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716831 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.716917 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717152 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717332 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717470 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717565 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717781 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.717874 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718122 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718229 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718437 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718522 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718753 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.718839 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719061 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719158 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719375 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719475 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719700 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.719793 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720018 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720116 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720325 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720412 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720634 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720719 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.720955 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.721053 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.721267 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.721353 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.721838 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.721930 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722171 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722259 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722488 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722586 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722799 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.722892 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723107 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723193 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723419 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723505 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723734 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.723826 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724045 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724132 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724349 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724432 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724651 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724738 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.724953 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725040 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725262 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725347 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725562 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725656 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725859 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.725945 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726183 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726283 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726491 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726586 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726790 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.726883 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727107 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727192 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727422 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727514 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727724 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.727809 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.728543 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.728633 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.728862 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729034 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729182 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729343 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729443 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729560 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729747 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.729884 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730078 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730219 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730388 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730525 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730690 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.730848 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731009 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731150 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731315 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731451 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731616 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731765 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.731937 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732072 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732238 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732378 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732538 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732685 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.732849 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733008 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733155 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733317 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733464 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733625 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733771 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.733955 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734114 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734310 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734425 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734612 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734737 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.734935 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735068 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735258 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735396 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735571 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735696 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.735873 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736018 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736181 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736389 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736529 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736653 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736770 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.736953 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737073 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737260 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737380 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737561 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737687 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737863 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.737990 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738191 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738317 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738499 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738617 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738799 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.738925 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739204 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739298 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739514 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739599 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739815 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.739900 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740113 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740203 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740412 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740496 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740727 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.740814 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741030 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741116 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741331 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741490 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741633 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741719 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.741972 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742147 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742302 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742398 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742621 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742706 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.742936 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.743021 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.743245 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.743343 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.743555 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.743647 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.744429 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.744584 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.744756 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.744925 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745072 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745209 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745385 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745530 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745705 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.745844 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746057 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746183 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746358 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746505 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746668 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746818 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.746988 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747139 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747292 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747452 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747605 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747777 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.747944 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748086 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748279 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748406 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748596 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748711 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.748916 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749052 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749226 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749347 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749539 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749680 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749848 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.749997 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750183 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750341 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750494 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750652 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750804 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.750966 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751122 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751275 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751433 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751586 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751750 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.751897 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752059 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752207 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752380 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752524 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752689 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.752834 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753006 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753152 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753309 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753464 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753622 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753787 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.753946 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754121 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754300 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754443 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754608 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754753 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.754920 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755070 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755238 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755396 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755546 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755727 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.755852 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756039 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756159 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756353 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756445 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756675 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756769 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.756985 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757077 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757294 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757380 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757603 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757689 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757907 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.757992 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758233 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758336 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758544 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758631 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758856 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.758962 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759165 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759275 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759512 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759663 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759810 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.759967 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760184 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760270 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760490 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760577 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760795 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.760889 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761099 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761195 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761410 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761503 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761729 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.761814 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762061 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762166 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762371 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762456 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762674 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762767 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.762976 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763071 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763276 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763361 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763594 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763686 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.763901 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764000 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764202 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764286 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764502 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764593 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764810 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.764897 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765117 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765201 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765426 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765512 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765736 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.765823 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766063 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766150 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766384 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766470 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766693 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.766778 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767001 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767085 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767308 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767391 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767615 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767701 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.767922 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768006 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768233 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768317 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768539 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768626 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768844 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.768927 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769150 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769291 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769458 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769551 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769759 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.769895 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770092 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770198 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770400 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770492 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770711 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.770965 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771050 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771296 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771385 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771605 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771696 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.771919 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772003 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772473 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772558 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772803 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.772889 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773116 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773203 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773430 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773516 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773747 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.773840 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774077 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774164 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774382 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774468 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774686 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.774772 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775064 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775293 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775449 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775611 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775754 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.775896 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776061 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776201 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776371 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776504 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776674 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776812 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.776980 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777115 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777292 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777417 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777599 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777719 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.777911 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778062 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778245 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778345 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778557 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778643 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778859 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.778952 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779180 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779266 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779490 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779584 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779791 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.779885 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780093 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780178 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780391 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780476 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780710 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.780808 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781017 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781103 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781318 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781403 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781618 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781711 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.781918 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782033 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782281 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782380 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782585 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782672 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782902 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.782992 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783206 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783292 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783509 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783595 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783811 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.783898 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784118 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784210 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784426 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784513 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784727 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.784819 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785027 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785111 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785330 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785417 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785637 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785722 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.785944 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786090 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786266 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786369 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786572 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786657 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786874 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.786973 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787180 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787266 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787485 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787568 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787785 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.787878 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788083 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788167 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788380 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788472 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788684 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788776 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.788984 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789070 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789282 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789366 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789580 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789664 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789883 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.789968 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.790210 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.790307 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.790508 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791383 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791471 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791691 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791781 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791860 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.791949 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792030 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792238 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792324 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792539 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792668 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792838 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.792926 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793144 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793229 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793446 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793540 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793747 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.793836 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794070 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794162 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794379 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794479 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794679 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794764 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.794987 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795072 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795286 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795447 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795585 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795670 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795884 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.795969 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796186 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796281 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796486 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796578 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796786 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.796870 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797083 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797176 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797384 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797468 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797683 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797775 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.797981 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798083 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798303 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798388 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798600 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798685 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798901 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.798988 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799203 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799288 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799501 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799585 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799798 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.799884 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800115 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800201 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800423 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800517 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800725 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.800818 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801026 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801112 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801326 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801421 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801666 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801751 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.801964 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802086 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802300 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802402 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802611 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802694 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.802914 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803000 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803227 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803322 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803536 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803620 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803843 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.803927 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804144 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804238 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804444 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804529 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804756 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.804840 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805062 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805147 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805371 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805456 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805672 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805758 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.805973 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.806078 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.806861 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807071 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807234 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807375 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807474 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807554 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807777 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.807864 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808091 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808184 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808401 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808496 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808699 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.808785 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809006 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809109 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809315 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809400 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809618 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809703 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.809926 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810075 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810259 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810354 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810562 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810653 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810870 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.810968 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811178 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811262 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811480 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811565 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811785 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.811879 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812086 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812171 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812389 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812480 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812695 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812788 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.812997 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813080 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813307 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813391 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813610 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813696 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.813908 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814053 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814238 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814372 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814541 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814686 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814848 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.814991 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815154 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815304 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815577 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815664 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815892 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.815977 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816203 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816297 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816507 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816599 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816816 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.816910 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817127 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817222 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817439 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817531 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817750 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.817835 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818072 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818178 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818432 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818518 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818744 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.818830 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819066 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819160 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819368 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819453 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819667 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819802 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.819967 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820054 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820272 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820395 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820573 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820658 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820882 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.820968 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.821183 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.821295 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.821484 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.821606 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.821910 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822518 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822599 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822677 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822755 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822833 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.822971 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823061 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823206 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823370 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823508 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823689 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.823917 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824003 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824227 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824313 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824535 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824694 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824854 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.824940 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825175 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825261 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825495 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825590 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825798 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.825883 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826135 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826237 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826441 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826537 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826763 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.826850 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827084 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827168 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827397 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827484 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827710 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.827803 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828013 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828124 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828334 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828446 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828656 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828741 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.828970 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829055 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829291 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829384 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829663 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829757 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.829966 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830067 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830313 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830399 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830614 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830702 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.830918 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831003 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831323 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831538 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831631 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831847 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.831933 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832148 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832242 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832453 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832538 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832754 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.832847 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833057 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833155 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833364 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833450 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833665 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833750 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.833969 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834110 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834296 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834382 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834600 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834693 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.834924 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835084 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835224 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835309 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835544 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835635 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835850 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.835936 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836154 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836241 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836456 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836555 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836759 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.836846 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837074 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837159 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837381 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837487 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837714 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.837871 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838073 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838167 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838406 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838493 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838715 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.838803 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839044 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839131 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839363 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839461 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839671 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839756 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.839986 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840095 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840310 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840406 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840616 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840731 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.840916 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841054 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841225 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841366 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841526 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841685 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.841830 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842045 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842184 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842336 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842452 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842670 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842770 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.842981 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843076 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843284 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843370 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843588 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843674 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843890 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.843988 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844198 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844291 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844498 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844584 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844807 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.844902 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845108 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845194 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845408 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845493 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845717 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.845811 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.846062 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.846201 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.846374 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.846473 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.846932 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847021 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847236 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847330 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847539 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847632 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847863 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.847953 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848184 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848271 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848501 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848588 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848814 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.848902 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849128 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849220 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849444 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849531 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849751 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.849837 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850081 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850169 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850399 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850499 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850708 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.850795 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851019 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851113 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851330 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851425 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851644 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851736 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.851959 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852158 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852275 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852485 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852581 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852797 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.852884 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.853690 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.853820 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854005 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854190 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854369 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854640 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854813 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.854953 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855145 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855264 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855460 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855575 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855775 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.855871 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856089 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856200 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856405 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856520 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856719 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.856842 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857032 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857170 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857342 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857484 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857654 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857797 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.857963 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858132 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858314 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858454 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858634 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858810 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.858956 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859123 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859288 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859429 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859603 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859740 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.859913 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860055 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860227 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860366 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860540 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860678 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860893 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.860992 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861205 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861300 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861510 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861596 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861821 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.861961 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862161 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862253 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862478 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862567 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862792 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.862879 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863104 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863191 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863415 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863501 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863727 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.863812 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864080 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864181 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864341 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864453 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864652 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864816 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.864967 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865168 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865289 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865484 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865621 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865815 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.865939 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866165 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866276 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866489 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866600 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866806 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.866894 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.867125 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.867388 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.867474 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.867700 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.867788 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.868033 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.868118 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.868343 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.868428 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.869293 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.869477 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.869621 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.869777 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.869940 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870126 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870235 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870441 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870533 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870758 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.870843 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871065 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871162 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871376 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871591 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871679 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.871939 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872035 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872254 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872341 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872582 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872695 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.872888 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873006 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873202 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873296 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873505 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873603 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.873829 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874060 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874154 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874407 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874499 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874724 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.874811 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875043 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875137 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875345 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875438 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875647 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875743 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.875957 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876050 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876265 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876360 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876568 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876668 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876870 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.876956 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877169 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877263 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877483 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877577 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877783 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.877868 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878105 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878192 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878409 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878510 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878715 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.878802 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879015 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879100 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879315 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879403 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879615 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879700 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.879912 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880003 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880218 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880305 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880518 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880611 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880819 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.880905 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881118 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881209 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881424 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881508 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881721 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.881805 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882043 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882181 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882344 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882433 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882654 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882750 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.882957 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883043 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883259 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883352 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883559 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883652 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883866 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.883992 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884163 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884250 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884499 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884661 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884822 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.884972 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.885091 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.885198 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.885397 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.885514 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.885700 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886030 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886265 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886366 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886601 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886690 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.886936 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887030 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887245 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887339 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887588 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887676 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887896 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.887981 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.888203 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.888511 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.888605 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.888832 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.888919 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889143 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889237 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889453 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889579 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889761 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.889918 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890092 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890249 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890406 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890543 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890717 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.890840 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891026 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891158 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891335 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891456 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891644 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891765 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.891956 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892074 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892294 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892389 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892634 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892721 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.892951 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893046 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893263 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893350 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893570 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893654 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893877 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.893976 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894212 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894313 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894520 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894614 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894828 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.894988 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895143 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895230 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895459 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895551 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895768 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.895854 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896071 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896159 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896376 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896486 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896684 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896797 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.896992 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897114 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897308 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897433 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897637 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897726 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.897950 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898080 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898279 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898380 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898683 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898768 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.898994 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899078 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899300 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899394 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899618 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899711 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.899947 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900039 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900276 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900447 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900594 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900715 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900892 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.900987 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901192 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901279 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901494 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901588 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901802 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.901891 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902156 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902248 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902473 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902560 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902793 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.902886 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903098 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903185 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903401 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903486 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903703 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.903788 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904010 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904098 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904325 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904413 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904640 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904736 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.904951 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905038 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905256 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905341 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905575 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905674 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905883 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.905977 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906216 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906303 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906528 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906625 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906839 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.906924 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907146 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907237 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907471 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907565 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907778 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.907865 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908086 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908171 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908393 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908479 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908702 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.908789 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909010 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909136 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909319 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909414 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909625 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909710 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.909951 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910062 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910278 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910366 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910593 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910716 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910902 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.910998 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911214 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911338 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911524 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911609 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911833 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.911931 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912155 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912246 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912462 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912547 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912774 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.912870 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913082 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913168 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913391 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913485 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913706 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.913793 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914047 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914138 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914368 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914454 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914615 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 17:57:50.914747 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.914994 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.915314 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.916174 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.916490 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.916933 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.917262 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 17:57:50.917505 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 17:57:50.937652 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_db.sqlalchemy.engines [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:50.939406 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_db.sqlalchemy.engines [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.111102 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.context [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bc56a97-2ac7-468b-8bd7-5b98997e3080(cell1) {{(pid=101360) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 17:57:51.112362 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.context [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bc56a97-2ac7-468b-8bd7-5b98997e3080(cell1) {{(pid=101359) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 17:57:51.115625 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_concurrency.lockutils [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 17:57:51.116547 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 17:57:51.117308 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_concurrency.lockutils [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 17:57:51.118189 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 17:57:51.118293 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_concurrency.lockutils [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 17:57:51.119232 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 17:57:51.120354 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_concurrency.lockutils [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 17:57:51.121301 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 17:57:51.130628 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_db.sqlalchemy.engines [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.131826 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_db.sqlalchemy.engines [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.134428 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_db.sqlalchemy.engines [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.139102 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_db.sqlalchemy.engines [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.397260 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG oslo_db.sqlalchemy.engines [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.400041 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_db.sqlalchemy.engines [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 17:57:51.817141 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: WARNING keystonemiddleware.auth_token [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 17:57:51.823799 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: WARNING keystonemiddleware.auth_token [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 17:57:51.853840 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: WARNING keystonemiddleware.auth_token [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 17:57:51.860340 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: WARNING keystonemiddleware.auth_token [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 17:57:52.171768 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: WARNING keystonemiddleware.auth_token [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 17:57:52.176926 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: WARNING keystonemiddleware.auth_token [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 17:57:52.182258 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570a279f9c0 pid: 101360 (default app) Jan 05 17:57:52.184326 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:57:52.185506 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Jan 05 17:57:52.186202 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Wed Jan 5 17:57:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:57:52.207422 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: WARNING keystonemiddleware.auth_token [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 17:57:52.213244 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: WARNING keystonemiddleware.auth_token [None req-9eaee5f1-f416-4488-b74a-fee4b1937f93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 17:57:52.218568 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570a279f9c0 pid: 101359 (default app) Jan 05 17:59:14.529472 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:14.532979 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 05 17:59:14.532979 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:14.953461 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-9200f492-5797-4d0d-a601-697083b0d374 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:14.982687 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-9200f492-5797-4d0d-a601-697083b0d374 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444665 Jan 05 17:59:14.983382 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jan 5 17:59:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:17.224995 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:17.226581 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d1ee2f31-eac3-46f1-8a72-c88b95e46a30 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 Jan 05 17:59:17.227083 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 17:59:17.288736 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-c7e03176-a3b4-49a7-806b-940aec04801c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "ram": 256}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:17.306825 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 17:59:17.306825 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 17:59:17.395964 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-c7e03176-a3b4-49a7-806b-940aec04801c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.162114 Jan 05 17:59:17.396842 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:17.625007 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-6bf9908f-6ca5-4865-8113-4942333e117f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:17.627237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 17:59:17.627237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: warnings.warn(msg) Jan 05 17:59:17.753177 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-6bf9908f-6ca5-4865-8113-4942333e117f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.347055 Jan 05 17:59:17.753968 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jan 5 17:59:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:19.963298 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-c7e03176-a3b4-49a7-806b-940aec04801c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:19.964306 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-c7e03176-a3b4-49a7-806b-940aec04801c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 05 17:59:19.964876 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:20.082270 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-cc62b48f-9918-4886-b7c1-9beaf29590f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "disk": 5}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:20.105405 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 17:59:20.105405 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: warnings.warn(msg) Jan 05 17:59:20.228090 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-cc62b48f-9918-4886-b7c1-9beaf29590f9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.256856 Jan 05 17:59:20.230159 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:20.244087 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-98c457bb-a8c2-4ab7-b3a3-e2f3307de76a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:20.245877 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 17:59:20.245877 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 17:59:20.399519 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-98c457bb-a8c2-4ab7-b3a3-e2f3307de76a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160089 Jan 05 17:59:20.400310 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jan 5 17:59:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:22.626687 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-cc62b48f-9918-4886-b7c1-9beaf29590f9 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:22.628493 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-cc62b48f-9918-4886-b7c1-9beaf29590f9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002334 Jan 05 17:59:22.629237 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:22.711022 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2b9ee672-5803-4c63-ad3c-dcad9410295e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "ram": 1024, "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:22.783445 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2b9ee672-5803-4c63-ad3c-dcad9410295e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146963 Jan 05 17:59:22.784081 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:22.796985 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-e465d220-3fa1-427d-a017-2bf28c1a62c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:22.868023 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-e465d220-3fa1-427d-a017-2bf28c1a62c3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074593 Jan 05 17:59:22.868623 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jan 5 17:59:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:25.121528 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2b9ee672-5803-4c63-ad3c-dcad9410295e admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:25.122757 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2b9ee672-5803-4c63-ad3c-dcad9410295e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jan 05 17:59:25.123269 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:25.182487 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-5e8e5ed3-1379-4349-8637-fa4b8ecbcd9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:25.268297 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-5e8e5ed3-1379-4349-8637-fa4b8ecbcd9c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138280 Jan 05 17:59:25.268857 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:25.281464 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-c2db6c4a-eb45-431b-915c-b7efcb196075 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:25.359405 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-c2db6c4a-eb45-431b-915c-b7efcb196075 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081456 Jan 05 17:59:25.359920 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jan 5 17:59:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:27.570581 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-5e8e5ed3-1379-4349-8637-fa4b8ecbcd9c admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:27.571826 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-5e8e5ed3-1379-4349-8637-fa4b8ecbcd9c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Jan 05 17:59:27.572367 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:27.634959 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:27.741709 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162076 Jan 05 17:59:27.742830 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 17:59:27.755018 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-f67df9cf-ce9a-417c-9241-c87287dc2d04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:27.850222 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-f67df9cf-ce9a-417c-9241-c87287dc2d04 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098783 Jan 05 17:59:27.851075 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Wed Jan 5 17:59:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 17:59:30.185969 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:30.186961 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jan 05 17:59:30.187388 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:30.247624 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-2f22efbf-2222-4216-b226-db2f25afe6d6 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:30.276002 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-2f22efbf-2222-4216-b226-db2f25afe6d6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081747 Jan 05 17:59:30.276714 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jan 5 17:59:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 17:59:33.297724 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:33.298819 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2e27ebbd-ac8d-4174-8c26-7367107e682c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jan 05 17:59:33.299215 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:33.365402 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-b3442604-f5a6-449a-8a8f-0e54031b52b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:33.432221 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-b3442604-f5a6-449a-8a8f-0e54031b52b3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.126307 Jan 05 17:59:33.432803 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:33.445712 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-72452406-53e9-4e10-b1be-f58e05986040 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:33.531528 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-72452406-53e9-4e10-b1be-f58e05986040 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089941 Jan 05 17:59:33.532028 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jan 5 17:59:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:35.832243 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-b3442604-f5a6-449a-8a8f-0e54031b52b3 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:35.833234 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-b3442604-f5a6-449a-8a8f-0e54031b52b3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 05 17:59:35.833626 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:35.892766 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-1b318ee2-e753-474c-80aa-d15aacf0c62c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "id": "2", "ram": 2048}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:35.980494 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-1b318ee2-e753-474c-80aa-d15aacf0c62c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140303 Jan 05 17:59:35.981119 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 17:59:35.993330 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-bb77f281-8e14-43cc-800d-f2d7281233d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:36.083502 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-bb77f281-8e14-43cc-800d-f2d7281233d9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093820 Jan 05 17:59:36.090044 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jan 5 17:59:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:38.307477 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-1b318ee2-e753-474c-80aa-d15aacf0c62c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:38.308523 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-1b318ee2-e753-474c-80aa-d15aacf0c62c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jan 05 17:59:38.308929 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:38.367629 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-073618d9-5ae6-4308-8ae7-8757dc8cbe72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:38.451832 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-073618d9-5ae6-4308-8ae7-8757dc8cbe72 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.136495 Jan 05 17:59:38.452373 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:38.465697 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-3673958d-0516-436c-bbe8-b242aacbca26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:38.543494 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-3673958d-0516-436c-bbe8-b242aacbca26 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081917 Jan 05 17:59:38.544172 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jan 5 17:59:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 17:59:40.761400 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-073618d9-5ae6-4308-8ae7-8757dc8cbe72 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:40.762632 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-073618d9-5ae6-4308-8ae7-8757dc8cbe72 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001835 Jan 05 17:59:40.763124 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:40.830146 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-61541b75-3678-4514-98f4-23e7587bffcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:40.893430 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-61541b75-3678-4514-98f4-23e7587bffcd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123430 Jan 05 17:59:40.894276 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:40.907301 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-7985825d-a3d7-4ba1-8039-d4951208d025 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:41.015654 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-7985825d-a3d7-4ba1-8039-d4951208d025 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112152 Jan 05 17:59:41.030219 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jan 5 17:59:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 17:59:43.260138 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-61541b75-3678-4514-98f4-23e7587bffcd admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 17:59:43.261160 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-61541b75-3678-4514-98f4-23e7587bffcd admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jan 05 17:59:43.261557 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 17:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 17:59:43.327334 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:43.621059 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.352584 Jan 05 17:59:43.630002 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Wed Jan 5 17:59:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 17:59:43.636760 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-8596f20a-9eeb-4694-b32d-58121c236593 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 17:59:44.486888 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-8596f20a-9eeb-4694-b32d-58121c236593 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.855083 Jan 05 17:59:44.497489 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Wed Jan 5 17:59:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:00:21.892134 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:21.893110 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 05 18:00:21.893504 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 18:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:21.950522 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-cabc707b-166b-4545-92f3-d0768304d87b admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:21.967143 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-cabc707b-166b-4545-92f3-d0768304d87b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066888 Jan 05 18:00:21.967681 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jan 5 18:00:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:00:23.400490 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:23.401489 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d37d055b-3087-4052-9afe-a3f2f674ccbc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jan 05 18:00:23.401880 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:23.592050 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2feeecd6-68c1-4b52-8739-85d468ef6492 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:23.597586 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.wsgi [None req-2feeecd6-68c1-4b52-8739-85d468ef6492 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 05 18:00:23.598692 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-2feeecd6-68c1-4b52-8739-85d468ef6492 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:23.599486 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-2feeecd6-68c1-4b52-8739-85d468ef6492 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058900 Jan 05 18:00:23.599996 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jan 5 18:00:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 18:00:23.609851 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-d5ca0ec9-580c-4a6a-babe-34f53b780775 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:23.631396 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-d5ca0ec9-580c-4a6a-babe-34f53b780775 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025068 Jan 05 18:00:23.631936 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:00:23.642156 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-93de3b6e-2d83-4827-80d1-ac89de6b344c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:23.663916 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-93de3b6e-2d83-4827-80d1-ac89de6b344c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025265 Jan 05 18:00:23.664446 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:00:23.674282 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-09f678a3-72c3-4b00-a7eb-b0f534419b1e admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:23.680264 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.wsgi [None req-09f678a3-72c3-4b00-a7eb-b0f534419b1e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 05 18:00:23.680829 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-09f678a3-72c3-4b00-a7eb-b0f534419b1e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:23.681622 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-09f678a3-72c3-4b00-a7eb-b0f534419b1e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010819 Jan 05 18:00:23.682131 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jan 5 18:00:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 18:00:25.036463 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-93de3b6e-2d83-4827-80d1-ac89de6b344c admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:25.037531 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-93de3b6e-2d83-4827-80d1-ac89de6b344c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 05 18:00:25.037929 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:00:25.229046 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-00c1446e-8ed3-4e7c-a6ac-0e76bff23f91 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:25.234168 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.wsgi [None req-00c1446e-8ed3-4e7c-a6ac-0e76bff23f91 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 05 18:00:25.234727 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-00c1446e-8ed3-4e7c-a6ac-0e76bff23f91 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:25.235511 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-00c1446e-8ed3-4e7c-a6ac-0e76bff23f91 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057071 Jan 05 18:00:25.236012 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jan 5 18:00:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 05 18:00:25.246438 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-5d29209a-f1bc-4a1f-a768-479ecc0d2d64 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:25.259765 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-5d29209a-f1bc-4a1f-a768-479ecc0d2d64 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016917 Jan 05 18:00:25.260423 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:00:25.270383 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-6716add5-2378-491e-b763-1a0074556821 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:25.283580 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-6716add5-2378-491e-b763-1a0074556821 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016614 Jan 05 18:00:25.284087 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:00:25.294309 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-02e7e35a-963b-4120-9da8-1c9bbfeeb74f admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:25.299281 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.wsgi [None req-02e7e35a-963b-4120-9da8-1c9bbfeeb74f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 05 18:00:25.299826 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-02e7e35a-963b-4120-9da8-1c9bbfeeb74f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:25.301294 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-02e7e35a-963b-4120-9da8-1c9bbfeeb74f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009782 Jan 05 18:00:25.301800 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Wed Jan 5 18:00:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 05 18:00:26.644042 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-6716add5-2378-491e-b763-1a0074556821 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:26.645095 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-6716add5-2378-491e-b763-1a0074556821 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jan 05 18:00:26.645482 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:26.833556 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-c3edcd8b-c8ad-4e3f-9052-ccc33c1e99dc admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:26.839053 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.wsgi [None req-c3edcd8b-c8ad-4e3f-9052-ccc33c1e99dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 05 18:00:26.839605 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-c3edcd8b-c8ad-4e3f-9052-ccc33c1e99dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101359) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:26.840383 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-c3edcd8b-c8ad-4e3f-9052-ccc33c1e99dc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057209 Jan 05 18:00:26.840878 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:00:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 18:00:26.852263 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-50a679ab-e6d5-47af-b407-9a1222bfcb6b admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:26.866197 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-50a679ab-e6d5-47af-b407-9a1222bfcb6b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018811 Jan 05 18:00:26.866711 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:00:26.876607 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:26.890042 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016887 Jan 05 18:00:26.890568 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Wed Jan 5 18:00:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:00:26.900158 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-4a391b60-6735-44ba-939f-17c445814194 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:26.905201 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.wsgi [None req-4a391b60-6735-44ba-939f-17c445814194 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 05 18:00:26.905759 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-4a391b60-6735-44ba-939f-17c445814194 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:00:26.906590 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-4a391b60-6735-44ba-939f-17c445814194 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009862 Jan 05 18:00:26.907073 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:00:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 05 18:00:28.262660 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:28.263662 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jan 05 18:00:28.264055 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:28.453648 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-f33650de-0a93-4696-8e5b-ecc085a339a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:00:28.537438 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-f33650de-0a93-4696-8e5b-ecc085a339a2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.134349 Jan 05 18:00:28.537900 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jan 5 18:00:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:00:29.905595 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:29.906632 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 05 18:00:29.907089 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:30.120537 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-931fe71b-4370-4045-976a-72f07ab96822 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:00:30.189473 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-931fe71b-4370-4045-976a-72f07ab96822 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.128615 Jan 05 18:00:30.190040 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jan 5 18:00:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:00:31.554644 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:31.555638 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jan 05 18:00:31.556029 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:31.747266 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-91e7c614-7d8b-4df1-933e-9582fe5a5e10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:00:31.853153 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-91e7c614-7d8b-4df1-933e-9582fe5a5e10 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.157553 Jan 05 18:00:31.853622 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jan 5 18:00:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:00:33.189955 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:33.191478 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jan 05 18:00:33.191478 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:33.381496 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-6804681f-4b98-483e-ae04-d6522bd77ca9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:00:33.461802 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-6804681f-4b98-483e-ae04-d6522bd77ca9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.132208 Jan 05 18:00:33.462401 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Wed Jan 5 18:00:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:00:34.814905 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:34.816007 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jan 05 18:00:34.816403 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:00:35.010883 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-46a6f8bd-c9f6-4f0f-b125-962ee65f388a admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:00:35.030229 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-46a6f8bd-c9f6-4f0f-b125-962ee65f388a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070121 Jan 05 18:00:35.030757 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Wed Jan 5 18:00:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:01:20.495797 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.496802 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-11e92603-8eee-4431-a413-074ff1753eaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 05 18:01:20.497227 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:01:20.554828 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-e8f02a6d-71f9-451e-82f9-e70088d4998d admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.573978 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-e8f02a6d-71f9-451e-82f9-e70088d4998d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069509 Jan 05 18:01:20.574540 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:01:20.596957 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-246dec6c-8610-46bb-9d7c-12aff1289f20 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.604683 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-246dec6c-8610-46bb-9d7c-12aff1289f20 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011750 Jan 05 18:01:20.605199 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:01:20.617372 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-47986e22-c8d8-442f-be8b-0ddb938f6b2e admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.625187 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-47986e22-c8d8-442f-be8b-0ddb938f6b2e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011344 Jan 05 18:01:20.625695 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:01:20.638143 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-d7638d5b-dbfd-4e6c-873c-1b5f020895db admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.645732 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-d7638d5b-dbfd-4e6c-873c-1b5f020895db admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011188 Jan 05 18:01:20.646294 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:01:20.658656 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:01:20.666080 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011590 Jan 05 18:01:20.666617 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Wed Jan 5 18:01:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:03:06.479488 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-909986ce-41d8-49ef-b7eb-d7e775752d8f tempest-verify_tempest_config-1992715741 tempest-verify_tempest_config-1992715741-project] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:03:06.482084 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-909986ce-41d8-49ef-b7eb-d7e775752d8f tempest-verify_tempest_config-1992715741 tempest-verify_tempest_config-1992715741-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106339 Jan 05 18:03:06.482614 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1133 bytes} [Wed Jan 5 18:03:06 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:04:33.331329 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:33.332416 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jan 05 18:04:33.332820 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:04:33.586803 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:33.587939 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:04:33.587939 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 18:04:33.589518 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:33.589952 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:33.590783 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:33.591224 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:33.624419 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-9a1bb7c7-0a8f-44fb-adac-87eb73f5f8ac admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.149412 Jan 05 18:04:33.624976 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:04:33 2022] GET /compute/v2.1/os-services => generated 785 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:04:34.994701 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:34.995954 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Jan 05 18:04:34.996389 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:04:35.186482 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:35.187631 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:04:35.187631 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 18:04:35.189136 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:35.189573 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:35.190387 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:35.190813 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:35.209483 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-ae4f7dab-80df-4d82-8008-ef0234827aa6 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.074292 Jan 05 18:04:35.209951 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 36/73] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:04:35 2022] GET /compute/v2.1/os-services => generated 785 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:04:46.998786 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:46.999881 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jan 05 18:04:47.000294 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:04:47.190095 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:47.191247 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:04:47.191247 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 18:04:47.192785 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:47.193221 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:47.194033 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:47.194483 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:47.219853 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-9da49254-c810-4a9b-811b-cf26e879d0e3 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.080176 Jan 05 18:04:47.220322 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:04:47 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:04:48.613566 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: DEBUG nova.api.openstack.wsgi [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] Calling method '>' {{(pid=101360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:48.614717 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: INFO nova.api.openstack.requestlog [None req-ccbdb655-d9b4-4fa2-960d-1c22f51d86a8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jan 05 18:04:48.615155 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: [pid: 101360|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1074 bytes} [Wed Jan 5 18:04:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:04:48.809995 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG nova.api.openstack.wsgi [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] Calling method '>' {{(pid=101359) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:04:48.811469 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:04:48.811469 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: warnings.warn(msg) Jan 05 18:04:48.813040 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:48.813476 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:48.814278 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:04:48.814697 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: DEBUG oslo_concurrency.lockutils [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101359) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:04:48.840404 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: INFO nova.api.openstack.requestlog [None req-a41c14ed-0e97-46ac-a1a5-459ab23fd2e1 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.077365 Jan 05 18:04:48.840404 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: [pid: 101359|app: 0|req: 38/77] 10.222.0.26 () {60 vars in 1193 bytes} [Wed Jan 5 18:04:48 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:05:45.906570 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: Wed Jan 5 18:05:45 2022 - graceful shutdown triggered... Jan 05 18:05:45.907082 dv-cinder-xena-3-iscsi devstack@n-api.service[101359]: Gracefully killing worker 1 (pid: 101359)... Jan 05 18:05:45.907479 dv-cinder-xena-3-iscsi devstack@n-api.service[101360]: Gracefully killing worker 2 (pid: 101360)... Jan 05 18:05:45.909510 dv-cinder-xena-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 05 18:05:46.907787 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: worker 1 buried after 1 seconds Jan 05 18:05:46.907787 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: worker 2 buried after 1 seconds Jan 05 18:05:46.907787 dv-cinder-xena-3-iscsi devstack@n-api.service[101358]: goodbye to uWSGI. Jan 05 18:05:46.909314 dv-cinder-xena-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 05 18:05:46.909881 dv-cinder-xena-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 05 18:05:46.912687 dv-cinder-xena-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 05 18:05:46.922673 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jan 5 18:05:46 2022] *** Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: nodename: dv-cinder-xena-3-iscsi Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: machine: x86_64 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: clock source: unix Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: pcre jit disabled Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: detected number of CPU cores: 4 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: current working directory: / Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: detected binary path: /usr/bin/uwsgi-core Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: your processes number limit is 47680 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: your memory page size is 4096 bytes Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: detected max file descriptor number: 2048 Jan 05 18:05:46.924733 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: lock engine: pthread robust mutexes Jan 05 18:05:46.925816 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: thunder lock: enabled Jan 05 18:05:46.925816 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 05 18:05:46.925816 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 05 18:05:46.970289 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: Python main interpreter initialized at 0x557cc1b3e9c0 Jan 05 18:05:46.970289 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: python threads support enabled Jan 05 18:05:46.970289 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: your server socket listen backlog is limited to 100 connections Jan 05 18:05:46.970289 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: your mercy for graceful operations on workers is 90 seconds Jan 05 18:05:46.970743 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: mapped 403077 bytes (393 KB) for 2 cores Jan 05 18:05:46.970743 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: *** Operational MODE: preforking *** Jan 05 18:05:46.970993 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: *** uWSGI is running in multiple interpreter mode *** Jan 05 18:05:46.970993 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: spawned uWSGI master process (pid: 116410) Jan 05 18:05:46.971196 dv-cinder-xena-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 05 18:05:46.971754 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: spawned uWSGI worker 1 (pid: 116428, cores: 1) Jan 05 18:05:46.972273 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: spawned uWSGI worker 2 (pid: 116429, cores: 1) Jan 05 18:05:46.972613 dv-cinder-xena-3-iscsi devstack@n-api.service[116410]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 05 18:05:48.782348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 18:05:48.782348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: from cryptography.utils import int_from_bytes Jan 05 18:05:48.783043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 18:05:48.783043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: from cryptography.utils import int_from_bytes Jan 05 18:05:48.784346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 18:05:48.784346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: from cryptography.utils import int_from_bytes Jan 05 18:05:48.784824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 05 18:05:48.784824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: from cryptography.utils import int_from_bytes Jan 05 18:05:51.407719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 18:05:51.408671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 18:05:51.409144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 18:05:51.409513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 18:05:51.409772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 18:05:51.410182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.410514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.410837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.411159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.411492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.411805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.412126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.412447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.412775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.413036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.413352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.413675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-xena-3-iscsi {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.413997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.414325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.414634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.414951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.415257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.415577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.415890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.416389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.418074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.418413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.418729 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.419086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.419405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.419734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.420066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.420366 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.420695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.421011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.421415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-xena-3-iscsi {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.421734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.422075 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.422396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.422983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.423298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.423615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.423943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.424275 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.424588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.424923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.425261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.425574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.425905 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.426241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.426555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.426873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.427197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.427507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.427816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.428072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.428307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 05 18:05:51.428811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.428968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 05 18:05:51.429147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.429147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.429495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 05 18:05:51.429647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.429808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 05 18:05:51.429961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.430189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 05 18:05:51.430350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.430503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.430664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.430825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.430978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431449 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.431905 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.432080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.432246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.432404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.432557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.432710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.433457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.433457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.433763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.433763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-xena-3-iscsi {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.434916 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435665 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.435971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.436116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.436882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437067 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437541 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437541 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.437984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438525 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.438976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.439280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.439433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.439597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.439741 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.439886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.440919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.441088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.441243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.441946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-xena-3-iscsi {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442451 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.442900 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.443043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.443043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.443572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.443731 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.443886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444501 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444662 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.444958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445744 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.445899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.446237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.446402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.447866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.448011 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.448274 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.448469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.449441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.449597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.449758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.449911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.449911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.450997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.451942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452232 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.452990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.453153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.453426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.453591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.453749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.453902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.454854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.455017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.455413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.455606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.455751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.455908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.456053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.456212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.456522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.457117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.457310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.457593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.457754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.457911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.458996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.459157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.459337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.459588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.459748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.459904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.460058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.460220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.460366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.460525 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.460671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.460823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.460969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.461113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.461266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.461485 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.461661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.462005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.462220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.462374 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.462542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.462688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.462840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.462984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.463129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.463273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.463427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.463572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.463725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.463877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.464029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.464181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.464358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.464514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.464660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.464804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.464956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.464956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.465251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.465396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.465547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.465699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.465843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.465997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.466178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.466335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.466487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.466639 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.466790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.467242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.467487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.467740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.467892 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.468044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.468189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.468345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.468500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.468646 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.468801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.469089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.469251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.469406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.469577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.469810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.469960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.470155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.470314 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.470466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.470612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.470766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.470919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.471075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.471220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.471365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.471516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.471677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.471822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.471967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.472119 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.472271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.472424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.472588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.472743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.472901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.473056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.473208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.473618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.473855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.474006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.474175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.474320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.474465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.474621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.474774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.474918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.475061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.475224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.475411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.475411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.475719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.475866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.476017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.476161 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.476312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.476457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.476615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.476774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.476929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.477370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.477632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.477893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.478066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.478217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.478373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.478526 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.478682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.478836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.478990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.479278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.479429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.479574 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.479729 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.479996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 05 18:05:51.480149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.480295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.480627 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.480837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.480987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.480987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.481274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.481419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.481572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.481717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.481871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.482971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.483905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484214 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.484948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.485905 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486700 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.486851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.487003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.487314 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.487635 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.487902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488741 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.488902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.489339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.489496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.489657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.489816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.489980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.490237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.490399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.490554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.490699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.490864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.491969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492834 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.492990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493136 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.493896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.494970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.495261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.495940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.496170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.496465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.496612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.496765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.496920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.497065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.497209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.497636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.497803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.498943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499099 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.499971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.500987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501438 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.501898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.502978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.503876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504787 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.504930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.505989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506617 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506761 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.506761 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.507050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.507209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.507369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.507780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.507932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.508093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.508350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.508595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.508779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.508941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509095 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509240 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.509980 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.510218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.510387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.510626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.510783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.510936 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.511134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.511780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.511936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512542 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.512989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.513902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514535 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514834 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.514985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515292 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.515898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.516938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.517093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.517248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.517475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.517903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.518105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.518268 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.518512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.518766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.518927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.519081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.519234 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.519387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.519564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.519873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520184 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.520996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521297 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.521930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.522848 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.523906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524504 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.524954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.525849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526510 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.526895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.527062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.527226 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.527382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.527527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.527680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.528108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.528280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.528435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.528677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.528930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529842 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.529996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.530192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.530362 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.530508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.530652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.530822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531674 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.531985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.532940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533100 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.533884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534744 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.534904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.535848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.536928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537230 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.537869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.538166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.538326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.538490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.538688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.538861 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.539113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.539279 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.539431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.539597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.539764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.540842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541583 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.541899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.542941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.543892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544202 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544504 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.544972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.545925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.546897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547624 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547624 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.547921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548641 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.548950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.549392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.549568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.549723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.549895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550517 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.550996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.551148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.551394 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.551567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.551721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.551721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.552963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553283 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.553972 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.554948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.555882 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556499 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556809 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.556809 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557574 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.557887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.558679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.558857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559020 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559600 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.559927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.560975 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.561137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.561306 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.561550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.561709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.561869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.562989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.563935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.564863 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565662 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.565973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.566946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567099 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567414 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.567891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.568874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.569949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.570162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.570345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.570541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.570696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.570862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571014 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.571893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572814 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.572974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.573134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.573287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.573437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.573650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.574970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.575959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576228 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.576993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577529 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.577986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578516 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.578917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.579935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580121 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580297 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.580946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.581976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582378 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582889 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.582973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583501 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.583939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584378 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584809 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.584992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585076 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585511 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.585972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586184 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586364 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586809 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.586980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.587939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588108 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.588991 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589807 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.589900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.590881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591784 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.591925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.592981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593074 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.593949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.594951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595646 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.595908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596052 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596430 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.596952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597128 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597306 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.597979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598267 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.598900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.599852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.600948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.601868 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602052 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.602994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.603947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604040 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.604966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.605968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.606982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.607931 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608347 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.608875 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609027 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.609865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.610991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.611122 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.611313 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.611436 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.611647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.611866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612202 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.612908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.613973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.614181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.614322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.614496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.614639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.614918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.615801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.616964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617073 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617274 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.617998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.618934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619244 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.619858 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.620066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.620174 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.620370 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621869 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.621970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.622992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.623934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.624077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.624252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.624388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.624572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.624878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.625096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.625231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.625415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.625551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.625753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.626867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.627819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.628967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.629912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630673 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.630882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.631856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632414 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.632867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.633986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634321 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.634947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.635907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.636010 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.636813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.637994 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638545 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638854 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.638949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.639896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.640799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.641938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.642897 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643368 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643629 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.643927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644244 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.644867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645729 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.645827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646306 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.646950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647052 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.647900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.648961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.649973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650154 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650468 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.650888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651741 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.651907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.652067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.652375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.652503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.652698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.652824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.653832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.654829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.655055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.655159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.655298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 18:05:51.655446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.655693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.656012 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.656346 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.656672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.656980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.657411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.657774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.658067 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.658393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.658705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.659030 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.659358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.659672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.659997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.660309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.660645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.660984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.661316 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.661645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.661954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.662289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.662598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.662908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.663246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.663608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.663884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.664198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.664524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.664836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.665160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.665485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.665806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.666140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.666480 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.666793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.667104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.667457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.667888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.668206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.668520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.668851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.669182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.669495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.669824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.670170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.670496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.670815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.671129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.671461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.671774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.672091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.672408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.672724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.673043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.673749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.673749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.673998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.674538 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.675044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.675580 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.675906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.676246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.676588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 05 18:05:51.676833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 05 18:05:51.678686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:51.699703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_db.sqlalchemy.engines [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:51.758875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.context [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bc56a97-2ac7-468b-8bd7-5b98997e3080(cell1) {{(pid=116428) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 18:05:51.763989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:05:51.765584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:05:51.766441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:05:51.768466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:05:51.779556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.context [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1bc56a97-2ac7-468b-8bd7-5b98997e3080(cell1) {{(pid=116429) load_cells /opt/stack/nova/nova/context.py:464}} Jan 05 18:05:51.779761 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:51.780596 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:51.784064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:05:51.785878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:05:51.786754 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:05:51.788711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:05:51.799548 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_db.sqlalchemy.engines [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:51.800375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_db.sqlalchemy.engines [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:52.039016 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:52.060748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_db.sqlalchemy.engines [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 05 18:05:52.369510 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: WARNING keystonemiddleware.auth_token [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 18:05:52.376930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: WARNING keystonemiddleware.auth_token [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 18:05:52.387619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: WARNING keystonemiddleware.auth_token [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 18:05:52.394299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: WARNING keystonemiddleware.auth_token [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 18:05:52.725328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: WARNING keystonemiddleware.auth_token [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 18:05:52.731463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: WARNING keystonemiddleware.auth_token [None req-ba4ac93b-d1c4-4be6-909f-4fd9a4b06ba6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 18:05:52.736600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cc1b3e9c0 pid: 116428 (default app) Jan 05 18:05:52.744422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: WARNING keystonemiddleware.auth_token [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 05 18:05:52.750667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: WARNING keystonemiddleware.auth_token [None req-21ac6873-8225-41e6-82c4-e7dbb9f122a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 05 18:05:52.755768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557cc1b3e9c0 pid: 116429 (default app) Jan 05 18:06:39.451776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b9104027-3369-4152-be1d-6c86cd615cff tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Action: 'create', calling method: .version_select at 0x7f73467858b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1945241725", "metadata": {"Type": "work"}}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:42.461719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b9104027-3369-4152-be1d-6c86cd615cff tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.290658 Jan 05 18:06:42.463048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jan 5 18:06:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4294 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 05 18:06:42.475101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-91f70a3a-aa1c-47bf-bea2-6c022ce169c4 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f734664e430>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:42.569215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-91f70a3a-aa1c-47bf-bea2-6c022ce169c4 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 200 len: 353 microversion: 2.1 time: 0.098260 Jan 05 18:06:42.574659 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:42 2022] GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:06:42.847043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-410245243", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "354933f9-6aab-4087-9b39-47856633edfb"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:43.510798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] validate_networks() for [('354933f9-6aab-4087-9b39-47856633edfb', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:06:43.584877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fcdc4314-3dc0-42ae-b2ea-b3fa471ecb2a tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f734664ec10>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:43.703449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fcdc4314-3dc0-42ae-b2ea-b3fa471ecb2a tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 200 len: 354 microversion: 2.1 time: 0.124177 Jan 05 18:06:43.704026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 3/3] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:43 2022] GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:06:43.775841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4a19ba46-c5e9-4052-92d1-8aa6ee07de3f tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f734664ed30>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:44.061568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4a19ba46-c5e9-4052-92d1-8aa6ee07de3f tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 200 len: 354 microversion: 2.1 time: 0.290670 Jan 05 18:06:44.062427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:43 2022] GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:06:44.075670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-64a6a48d-0b70-4f28-b70b-a2154263bbb8 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f7346663670>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:44.451748 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-64a6a48d-0b70-4f28-b70b-a2154263bbb8 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 202 len: 0 microversion: 2.1 time: 0.374431 Jan 05 18:06:44.451748 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:06:44 2022] DELETE /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:06:44.453642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9ce909ff-f2d5-41dd-b982-8b5fc8f7de27 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f734664ee50>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:44.511043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9ce909ff-f2d5-41dd-b982-8b5fc8f7de27 tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 200 len: 353 microversion: 2.1 time: 0.060834 Jan 05 18:06:44.512026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:44 2022] GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:06:45.124844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:06:45.124844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:06:45.124844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:06:45.125489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:06:45.125601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:06:45.150822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:45.162190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:45.162190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:45.162190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:45.235598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Getting quotas for project a2146dec079e43c6879b09741cb3e64f. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:45.251440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Getting quotas for user 2ba972bae0194126ba14be44627e41eb and project a2146dec079e43c6879b09741cb3e64f. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:45.275085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:06:45.288879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:06:45.523649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-88a589e9-1e97-4860-ab03-176da60f9a1d tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Calling method '.version_select at 0x7f734664e9d0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:45.570529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-54ed25e3-d3a3-40b0-a378-649e7cdac8cc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.382183 Jan 05 18:06:45.572358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 1/7] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:06:45.578620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-88a589e9-1e97-4860-ab03-176da60f9a1d tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] HTTP exception thrown: Volume 618f0114-9446-4da0-a8dc-e97a4d211c90 could not be found. Jan 05 18:06:45.579358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-88a589e9-1e97-4860-ab03-176da60f9a1d tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] Returning 404 to user: Volume 618f0114-9446-4da0-a8dc-e97a4d211c90 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:06:45.580195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-88a589e9-1e97-4860-ab03-176da60f9a1d tempest-VolumesGetTestJSON-177495318 tempest-VolumesGetTestJSON-177495318-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90" status: 404 len: 109 microversion: 2.1 time: 0.060381 Jan 05 18:06:45.581350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 7/8] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:45 2022] GET /compute/v2.1/os-volumes/618f0114-9446-4da0-a8dc-e97a4d211c90 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:06:45.585696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-06a981aa-8a7d-48c4-a447-d32434e9d423 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:45.587534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-06a981aa-8a7d-48c4-a447-d32434e9d423 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:45.802290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-06a981aa-8a7d-48c4-a447-d32434e9d423 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:45.838698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-06a981aa-8a7d-48c4-a447-d32434e9d423 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1214 microversion: 2.1 time: 0.260005 Jan 05 18:06:45.846153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 2/9] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:45 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:06:46.857307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-afbc62f3-0927-4b24-b2fe-4ec0e5aef2ab tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:46.858153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-afbc62f3-0927-4b24-b2fe-4ec0e5aef2ab tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:47.099345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-afbc62f3-0927-4b24-b2fe-4ec0e5aef2ab tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:47.115659 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-afbc62f3-0927-4b24-b2fe-4ec0e5aef2ab tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1214 microversion: 2.1 time: 0.263361 Jan 05 18:06:47.121421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 8/10] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:46 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:48.137875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2ac972f9-660a-4ad0-aa7b-ccef6a2837c2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:48.138678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2ac972f9-660a-4ad0-aa7b-ccef6a2837c2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:48.335979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2ac972f9-660a-4ad0-aa7b-ccef6a2837c2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:48.358073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2ac972f9-660a-4ad0-aa7b-ccef6a2837c2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1214 microversion: 2.1 time: 0.215710 Jan 05 18:06:48.358859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 9/11] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:48 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:06:48.522050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: .version_select at 0x7f7345da3dc0>, body: {"keypair": {"name": "tempest-keypair-563862781"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:48.617165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:48.626214 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:49.365773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:49.366415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:49.387063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:49.387875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:49.388608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:49.389115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:49.563085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:49.574588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:49.613303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d4d0416d-ef95-4755-a1b9-65ba91b2ca9f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.675467 Jan 05 18:06:49.621117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 3/12] 10.222.0.26 () {60 vars in 1157 bytes} [Wed Jan 5 18:06:47 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:49.697375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:49.709483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9f639124-a572-4150-b05a-c5fef203ed76 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1218 microversion: 2.1 time: 0.348616 Jan 05 18:06:49.710691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 10/13] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:49 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:50.114976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1793971580", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9bbfc51-59c9-41b3-9c9a-acaafcd8b283"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:50.213677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] validate_networks() for [('d9bbfc51-59c9-41b3-9c9a-acaafcd8b283', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:06:50.729228 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:50.730640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:50.743943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:50.745847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:50.748620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:50.749226 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:50.915204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:06:50.915681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:06:50.916071 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:06:50.916640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:06:50.917065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:06:50.928451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:50.929397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:50.930935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:50.931762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:50.960382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Getting quotas for project 43b4fd64462549c59ae7f47dfc02af1e. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:50.983503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Getting quotas for user 8de0f34c7c1e4d5b90bbab65d6f66efc and project 43b4fd64462549c59ae7f47dfc02af1e. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:50.998293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:51.010175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-63b29523-2248-43c0-a32b-f950754440c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1218 microversion: 2.1 time: 0.285611 Jan 05 18:06:51.012695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:50 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1218 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:51.026649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:06:51.029444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:06:51.276611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-807a47d8-d287-42d6-90ca-acc954ca15d0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.349544 Jan 05 18:06:51.277429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 4/15] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:06:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:06:51.297430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5a08fea8-211e-4b92-ae40-093cb3dfa85e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:51.298542 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5a08fea8-211e-4b92-ae40-093cb3dfa85e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:51.386701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5a08fea8-211e-4b92-ae40-093cb3dfa85e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:51.395994 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5a08fea8-211e-4b92-ae40-093cb3dfa85e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1222 microversion: 2.1 time: 0.102004 Jan 05 18:06:51.410334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 12/16] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:51 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:51.730082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1121786211", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9bbfc51-59c9-41b3-9c9a-acaafcd8b283"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:51.831334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] validate_networks() for [('d9bbfc51-59c9-41b3-9c9a-acaafcd8b283', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:06:52.029319 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:52.030568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:52.042316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:52.042985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:52.045016 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:52.045690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:52.162460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:52.170046 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1931f986-dfd8-4f3f-9b4a-6c53f39ab690 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1218 microversion: 2.1 time: 0.145739 Jan 05 18:06:52.178258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 13/17] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:52 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:53.078416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:06:53.078416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:06:53.078416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:06:53.078416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:06:53.078416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:06:53.090731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:53.091438 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:53.092264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:53.092706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:53.120980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Getting quotas for project 43b4fd64462549c59ae7f47dfc02af1e. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:53.136265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Getting quotas for user 8de0f34c7c1e4d5b90bbab65d6f66efc and project 43b4fd64462549c59ae7f47dfc02af1e. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:53.159959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:06:53.162753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:06:53.208993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:53.209648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:53.224155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:53.226670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:53.230128 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:53.238868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:53.366856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-64eea5d6-15ae-44d2-a538-81beec143a34 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.640050 Jan 05 18:06:53.379266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:53.382968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 5/18] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:06:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:06:53.391795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fa039305-0a84-45b3-ac13-27fbeb8d6017 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1218 microversion: 2.1 time: 0.187617 Jan 05 18:06:53.410903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a60b1f9-9730-415b-bb14-8b9847961295 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:53.411422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 14/19] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:53 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:06:53.416119 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a60b1f9-9730-415b-bb14-8b9847961295 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:53.502750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2a60b1f9-9730-415b-bb14-8b9847961295 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:53.520998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a60b1f9-9730-415b-bb14-8b9847961295 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1222 microversion: 2.1 time: 0.131332 Jan 05 18:06:53.535005 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 6/20] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:53 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:54.173824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-748407700", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0da28a8c-2ce1-4e0e-9a84-da0477c6194b"}], "security_groups": [{"name": "tempest-securitygroup--249245978"}], "key_name": "tempest-keypair-563862781", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:06:54.348987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] validate_networks() for [('0da28a8c-2ce1-4e0e-9a84-da0477c6194b', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:06:54.412547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:54.414120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:54.428402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:54.428857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:54.432203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:54.432724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:54.689169 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:54.706939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-874f46fd-8483-4e1c-b178-57ce1201e2d7 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1266 microversion: 2.1 time: 0.298064 Jan 05 18:06:54.708821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:54 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:54.716614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:54.717412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:54.723995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:54.724671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:54.726389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:54.730399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:54.846483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:54.854921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c12331e0-6b9c-44fe-8f8d-99f2f50a6d27 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1226 microversion: 2.1 time: 0.143326 Jan 05 18:06:54.855510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 8/22] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:54 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:54.863126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a74359b5-0243-490e-9e40-bda028b88bb9 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7344c9e5e0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:55.052327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a74359b5-0243-490e-9e40-bda028b88bb9 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/03395c7d-3c64-4edc-adf2-1bee35c6d2b8" status: 200 len: 350 microversion: 2.1 time: 0.192985 Jan 05 18:06:55.060894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 9/23] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:54 2022] GET /compute/v2.1/os-volumes/03395c7d-3c64-4edc-adf2-1bee35c6d2b8 => generated 350 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:06:55.259200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:06:55.259800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:06:55.260284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:06:55.260694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:06:55.261099 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:06:55.274962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.275403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:55.276190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.276614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:55.306155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:06:55.312402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:06:55.324708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:06:55.328109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:06:55.537225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-04d93899-bd9e-4a3f-b79c-3307f457d887 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.367985 Jan 05 18:06:55.538933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 15/24] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:06:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 18:06:55.549088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b325c58e-d0ad-45ab-ba19-4c08480aecfd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:55.549884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b325c58e-d0ad-45ab-ba19-4c08480aecfd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:55.650675 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b325c58e-d0ad-45ab-ba19-4c08480aecfd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:55.659472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b325c58e-d0ad-45ab-ba19-4c08480aecfd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1236 microversion: 2.1 time: 0.114542 Jan 05 18:06:55.665023 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 10/25] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:55 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1236 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:55.728428 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:55.728765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:55.735503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.736139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:55.737135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.737724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:55.806478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:55.814100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-12076341-f1bf-468a-93c7-afc0f1b92b20 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1272 microversion: 2.1 time: 0.092874 Jan 05 18:06:55.814672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 16/26] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:55 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:55.877808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:55.878955 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:55.930004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.930556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:55.934208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:55.934711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:56.158156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:56.171118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-af1e4cdc-e84a-4388-b04b-7b942a091c5d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1274 microversion: 2.1 time: 0.296541 Jan 05 18:06:56.171118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 11/27] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:55 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:56.685747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3d0086e6-39fb-4295-acda-8d01574c95ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:56.686787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3d0086e6-39fb-4295-acda-8d01574c95ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:56.755331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3d0086e6-39fb-4295-acda-8d01574c95ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:56.794300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3d0086e6-39fb-4295-acda-8d01574c95ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1236 microversion: 2.1 time: 0.119812 Jan 05 18:06:56.798322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:56 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:56.832596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:56.834365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:56.855503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:56.855962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:56.856949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:56.857542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:57.203150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:57.204148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:57.215846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:57.226193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:57.226193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:57.226193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:57.332138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:57.344757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-023afd5e-23aa-4544-a48d-acd8e8c5ad43 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.142880 Jan 05 18:06:57.345472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 18/29] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:57 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:06:57.389635 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:57.412231 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2c263bdb-e8cd-4cd7-b775-73609a28890a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.583240 Jan 05 18:06:57.425167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 12/30] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:56 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:57.812388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b5c5c104-ced6-48cd-a11d-60fed203e86f tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7345c54820>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:57.820453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:57.824031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:57.838865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:57.839561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:57.841984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:57.843505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:57.960238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:57.974098 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ef6cb6d9-9870-4cf2-a994-a7c517abccf4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.157773 Jan 05 18:06:57.975591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 13/31] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:57 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:58.239379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b5c5c104-ced6-48cd-a11d-60fed203e86f tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9821b45d-cfbe-4dda-ba48-35321924ceaa" status: 200 len: 351 microversion: 2.1 time: 0.431224 Jan 05 18:06:58.241998 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 19/32] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:06:57 2022] GET /compute/v2.1/os-volumes/9821b45d-cfbe-4dda-ba48-35321924ceaa => generated 351 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:06:58.384335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:58.384335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:58.384335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:58.384335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:58.387530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:58.388217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:58.435468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:58.435468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:58.441833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:58.442805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:58.444086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:58.444669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:58.479198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:58.490473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f6dd1240-45e7-45c6-a5ea-ed417d5bdb22 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.125957 Jan 05 18:06:58.493518 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 14/33] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:58 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:58.650337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:58.657864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-aad30720-7e2b-45c1-a278-2916cd00f50c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.230144 Jan 05 18:06:58.658488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 20/34] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:58 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:06:58.992146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:58.992963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:58.999224 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:58.999695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.000473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:59.000915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.090907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:59.099216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5345602c-ed4d-41a4-84d7-de0bacb471d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.110718 Jan 05 18:06:59.099876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 15/35] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:58 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:59.538155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:59.538155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:59.538155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:59.538155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.539022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:59.539022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.589525 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:59.597204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-73793564-bd9e-4418-bab2-b0087bc8ad0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.089047 Jan 05 18:06:59.597860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 21/36] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:59 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:06:59.674114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:06:59.674738 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:06:59.693593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:59.694311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.695344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:06:59.696506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:06:59.852697 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:06:59.863254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3b93dd9a-487b-423f-8705-3a1885ba7d01 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.192575 Jan 05 18:06:59.864926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 16/37] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:06:59 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:00.117179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:00.118177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:00.123988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.124439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:00.125205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.125639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:00.183701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:00.190984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cdcc7bf1-8595-4924-8a4b-3d4d2fcc270d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.077557 Jan 05 18:07:00.191550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 22/38] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:00 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:00.614150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:00.614785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:00.621395 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.621847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:00.622658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.623097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:00.681581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:00.689337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-180dec8e-7225-4552-8fe2-51d952038cd3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.078552 Jan 05 18:07:00.690078 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 17/39] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:00 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:00.886415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:00.887025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:00.892868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.894763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:00.894763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:00.894763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:01.017160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:01.024679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-60786707-835b-4878-962f-3b96d44be1c1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.148491 Jan 05 18:07:01.025487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 23/40] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:00 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:01.208190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:01.208805 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:01.215311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:01.215763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:01.216541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:01.216978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:01.275628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:01.283068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d3fdc936-e496-4820-94a5-2393cd1f431b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.078515 Jan 05 18:07:01.283964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 18/41] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:01 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:01.706647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:01.707251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:01.712977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:01.713419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:01.714211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:01.714641 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:01.775949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:01.783146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-82bf7d23-f695-49ef-8300-d9ad74b5f5ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.080146 Jan 05 18:07:01.783923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 24/42] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:01 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:02.041325 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:02.042477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:02.048756 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.049310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.050208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.050713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.222392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:02.230463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f3407c07-2251-4ad6-9df7-745c9622eb6f tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.193595 Jan 05 18:07:02.231024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 19/43] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:02 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:02.300646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:02.301184 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:02.307284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.307738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.308515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.308952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.372453 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:02.378701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8f619f6c-79e6-4abb-90dc-e2a80f501880 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.081821 Jan 05 18:07:02.380192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 25/44] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:02 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:02.802785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:02.803892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:02.812277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.812889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.813486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:02.814264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:02.880942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:02.888730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7bd544d6-0ec6-4237-9ccb-28b2ae2041a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.091792 Jan 05 18:07:02.889301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 20/45] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:02 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:03.247456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:03.248070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:03.253811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.254360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.255129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.255569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.371336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:03.378356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-467f2eef-b454-4530-b2ce-7bef5c1cf0a3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.134471 Jan 05 18:07:03.378921 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 26/46] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:03 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:03.396258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:03.396896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:03.403034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.403478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.404241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.404696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.462461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:03.469719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d7eeca3c-20dd-445c-8f21-ea062fd48c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.076930 Jan 05 18:07:03.472835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 21/47] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:03 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:03.905759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:03.906827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:03.912776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.913227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.913989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:03.914508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:03.990303 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:03.998898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-65a24b64-13dc-41fa-9af7-493cd83d5360 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.096856 Jan 05 18:07:03.999574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 27/48] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:03 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:04.395593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:04.396787 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:04.403586 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:04.404034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:04.404820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:04.405415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:04.490332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:04.490946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:04.521236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:04.527493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:04.528496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:04.529084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:04.588335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:04.599032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-71128728-45d2-48ef-966f-5165df6b9a19 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.206649 Jan 05 18:07:04.600234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 22/49] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:04 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:04.629087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:04.637080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b01ca501-4836-4aed-a5fb-e6c5d9f2f0f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.150234 Jan 05 18:07:04.637821 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 28/50] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:04 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:05.016332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:05.016945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:05.022562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.023020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.024946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.025385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.084831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:05.093509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c3dfbffd-be93-485e-9470-59f5b2eb1075 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.080842 Jan 05 18:07:05.094838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 23/51] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:05 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:05.617756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:05.618397 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:05.624120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.624571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.625331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.625834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.654659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:05.655270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:05.660991 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.661441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.662243 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:05.662685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:05.720880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:05.728317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-05bcfd24-43dd-4068-9a53-c75dc90e2e41 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.077262 Jan 05 18:07:05.728876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 24/52] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:05 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:05.741173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:05.748783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-db0e4e07-2ca5-443c-b3c1-d50b746519c6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.135101 Jan 05 18:07:05.749337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 29/53] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:05 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:06.112865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:06.114318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:06.122047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.123002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.123921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.124667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.189302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:06.197134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bc6e2ab2-f7f5-4b60-a7ba-c53665ed5da6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.088500 Jan 05 18:07:06.197563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:06 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:06.745129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:06.745891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:06.752422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.752968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.753829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.754361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.765316 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:06.765931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:06.772019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.772471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.773250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:06.774546 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:06.830261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:06.840728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-76e53c75-c30a-43a4-984f-5df4bae9d784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.099239 Jan 05 18:07:06.863090 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:06 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:06.930826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:06.938907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bdf1cd04-0dde-40a3-b857-f547cbafaa9c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.177430 Jan 05 18:07:06.949247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 26/56] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:06 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:07.213258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:07.213843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:07.219778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.220205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:07.221002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.221441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:07.281707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:07.288858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1ec37d99-7415-41e1-8be7-1485b025d28f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.079802 Jan 05 18:07:07.292269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 31/57] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:07 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:07.861050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:07.863833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:07.867717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.868165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:07.868934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.869367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:07.938341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:07.945998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9d8a05a6-bd4f-472c-932c-f3e02f0cd0cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.088823 Jan 05 18:07:07.947208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 27/58] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:07 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:07.957804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:07.958487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:07.967262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.967262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:07.968234 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:07.968712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:08.097978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:08.111795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-836aa53a-a075-45d3-9b19-7bca22bfcd67 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.157638 Jan 05 18:07:08.112359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 32/59] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:07 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:08.306531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:08.307139 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:08.313057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:08.315946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:08.315946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:08.315946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:08.374269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:08.381210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-69583b43-dc5f-45fa-9e19-3595f623f485 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.078817 Jan 05 18:07:08.381775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 28/60] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:08 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:08.793828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8277d545-ca21-415a-aabe-6babb6d61744 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f734540e160>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:08.844060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8277d545-ca21-415a-aabe-6babb6d61744 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9184a5e5-f919-436d-914a-5f3e19c20936" status: 200 len: 351 microversion: 2.1 time: 0.054476 Jan 05 18:07:08.844619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 33/61] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:07:08 2022] GET /compute/v2.1/os-volumes/9184a5e5-f919-436d-914a-5f3e19c20936 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:08.856309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d9aa5108-ab4c-4640-8f91-b20eb0761b23 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7344c9e700>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:08.933862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d9aa5108-ab4c-4640-8f91-b20eb0761b23 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081828 Jan 05 18:07:08.934514 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 29/62] 10.222.0.26 () {58 vars in 1133 bytes} [Wed Jan 5 18:07:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:08.946860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6ee4bab5-d2a5-48c9-9a31-b6d2645a774d tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7345c6f1f0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:08.961606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:08.962780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:08.968720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:08.969352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:08.970165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:08.970599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:09.031199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6ee4bab5-d2a5-48c9-9a31-b6d2645a774d tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088503 Jan 05 18:07:09.031761 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 34/63] 10.222.0.26 () {58 vars in 1148 bytes} [Wed Jan 5 18:07:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:09.040606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:09.043253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-065dd9bb-d41f-4a26-a017-8ed557398d69 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7345c7b040>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.047830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1fea24fd-06ca-4dc7-82e2-8ebf9b6d9eb2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1240 microversion: 2.1 time: 0.089799 Jan 05 18:07:09.048384 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:08 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:09.124202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-065dd9bb-d41f-4a26-a017-8ed557398d69 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084219 Jan 05 18:07:09.125188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1133 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:09.129716 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.130366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:09.136722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f1ff3752-2d9c-4559-9591-abe47f01583b tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7345c6f040>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.137343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:09.137792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:09.138605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:09.139029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:09.220808 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f1ff3752-2d9c-4559-9591-abe47f01583b tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088320 Jan 05 18:07:09.221391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 36/66] 10.222.0.26 () {58 vars in 1166 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:07:09.233621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-acf7b469-1e3a-427e-921e-168f2257533f tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f734540e430>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.273483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:09.296679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c5439a8a-1cd4-4f7f-bbaa-5fcda0600fcf tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.170399 Jan 05 18:07:09.297368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 31/67] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:09.351895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-acf7b469-1e3a-427e-921e-168f2257533f tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.122137 Jan 05 18:07:09.353379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 37/68] 10.222.0.26 () {58 vars in 1169 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:09.368538 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-12a98af7-6c6e-4b3f-850a-2e99d516d693 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7344c9e820>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.401209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.402095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:09.418221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:09.419550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:09.421503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:09.423119 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:09.549828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-12a98af7-6c6e-4b3f-850a-2e99d516d693 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.188135 Jan 05 18:07:09.550727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 32/69] 10.222.0.26 () {58 vars in 1154 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:09.570438 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-70906d3e-61a1-4970-937f-ec9552c8b4f0 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f7344c0b700>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:09.577240 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:09.587772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7555a508-bc00-4c19-83c9-7b546f470f2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1282 microversion: 2.1 time: 0.191705 Jan 05 18:07:09.588963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 38/70] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:09.745793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-70906d3e-61a1-4970-937f-ec9552c8b4f0 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.186575 Jan 05 18:07:09.746650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 33/71] 10.222.0.26 () {58 vars in 1187 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:09.758143 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-99aeddf0-b9bd-4410-84d5-30ce11df2399 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] Calling method '.version_select at 0x7f734540e1f0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:10.065853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:10.068732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:10.078996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.082486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.083401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.093425 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.162247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-99aeddf0-b9bd-4410-84d5-30ce11df2399 tempest-VolumesTestJSON-302924731 tempest-VolumesTestJSON-302924731-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.407948 Jan 05 18:07:10.172945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 39/72] 10.222.0.26 () {58 vars in 1154 bytes} [Wed Jan 5 18:07:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:10.180947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:10.189824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1cbc08b9-f7cd-4078-a78a-23b87a17ed24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1288 microversion: 2.1 time: 0.128778 Jan 05 18:07:10.194497 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 34/73] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:10 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1288 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:10.313606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:10.314270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:10.320398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.321689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.322960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.323479 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.579965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:10.591371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0340ab80-4d39-4058-a397-11ef4f034944 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.281281 Jan 05 18:07:10.592541 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 40/74] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:10 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:10.606185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:10.608034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:10.620037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.620669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.621482 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:10.621912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:10.720869 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:10.726276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-34e3fb01-4d88-48f0-82a7-79e43010e58b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1280 microversion: 2.1 time: 0.125751 Jan 05 18:07:10.742080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 35/75] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:10 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1280 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:11.055881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-b08d8b63-c9e1-40ec-9ba4-df24cb774c8e req-c43509d6-185b-4271-b104-014c49446827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5d27f4-8ffb-42ff-828c-93226d23a340", "tag": "fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:11.059127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:11.059127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:11.070916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-b08d8b63-c9e1-40ec-9ba4-df24cb774c8e req-c43509d6-185b-4271-b104-014c49446827 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.071605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-b08d8b63-c9e1-40ec-9ba4-df24cb774c8e req-c43509d6-185b-4271-b104-014c49446827 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.100798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-b08d8b63-c9e1-40ec-9ba4-df24cb774c8e req-c43509d6-185b-4271-b104-014c49446827 service nova] Creating event network-changed:fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c for instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 on hv-cinder-xena0 Jan 05 18:07:11.100798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-b08d8b63-c9e1-40ec-9ba4-df24cb774c8e req-c43509d6-185b-4271-b104-014c49446827 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116428) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 05 18:07:11.100798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.100798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.100798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.101678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.111916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.compute.rpcapi [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 05 18:07:11.113081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] Releasing lock "compute-rpcapi-router" {{(pid=116428) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 05 18:07:11.135390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-485b0949-956f-41d1-81dc-010d9265e76a None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169537 Jan 05 18:07:11.137109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 41/76] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:07:11.212174 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:11.213008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:11.218761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.219433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.220564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.221354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.451533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:11.469743 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e6f00638-6b90-4d97-83e0-3a0b8bd3ba67 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1296 microversion: 2.1 time: 0.261798 Jan 05 18:07:11.471293 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 36/77] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:11 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1296 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:11.576646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-b07ddbcf-fa9e-4bf0-8303-a30a84c0c93e req-bef5bf2a-3f24-49a9-8a32-fe8e6e241307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ddb291a-0f29-4cc4-8030-63b5c9bad269", "tag": "df48552c-b3ac-4d6c-9e6d-2d520990ed4f"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:11.578353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:11.578353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:11.592198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-b07ddbcf-fa9e-4bf0-8303-a30a84c0c93e req-bef5bf2a-3f24-49a9-8a32-fe8e6e241307 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.592198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-b07ddbcf-fa9e-4bf0-8303-a30a84c0c93e req-bef5bf2a-3f24-49a9-8a32-fe8e6e241307 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.599746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-b07ddbcf-fa9e-4bf0-8303-a30a84c0c93e req-bef5bf2a-3f24-49a9-8a32-fe8e6e241307 service nova] Creating event network-changed:df48552c-b3ac-4d6c-9e6d-2d520990ed4f for instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 on hv-cinder-xena0 Jan 05 18:07:11.615958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-b07ddbcf-fa9e-4bf0-8303-a30a84c0c93e req-bef5bf2a-3f24-49a9-8a32-fe8e6e241307 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170402 Jan 05 18:07:11.618460 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:11.621935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:11.625948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.626505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 42/78] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:11.626701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.627502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.628182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.745190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:11.746170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:11.752424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.753101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.754108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:11.754775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:11.995886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:12.005763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0f1cca9d-8280-423f-9cdc-fb826f412ae6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.400302 Jan 05 18:07:12.007105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 37/79] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:11 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:12.153070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:12.161306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7ccf10a0-95db-4192-9e21-cd0960697716 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.421659 Jan 05 18:07:12.170830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 43/80] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:11 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:12.488884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:12.491209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:12.499205 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:12.499982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:12.500987 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:12.501615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:12.648277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:12.656084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-65bef452-569f-4b26-b3a9-efe1bde191f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1294 microversion: 2.1 time: 0.171165 Jan 05 18:07:12.656664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 38/81] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:12 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:13.032362 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:13.034628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:13.045732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.046463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.048154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.048740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.181779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:13.181779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:13.187491 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.187945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.188735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.189169 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.220773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:13.231633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-67247366-5562-49c7-ad20-06b23291042c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.202820 Jan 05 18:07:13.232892 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 44/82] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:13 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:13.562777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:13.571986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-00567da0-f5ad-4195-a7f1-baff7852c369 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.397189 Jan 05 18:07:13.572864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 39/83] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:13 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:13.675813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-31fe81be-008c-47be-b208-d5bc01096af6 req-d39b6485-0aee-4049-89ca-181f9323615e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fc46c6-cb73-4f7e-806b-4e68fdf9c293", "tag": "7996838c-af81-4f6b-8afa-9b8a7c826137"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:13.677278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:13.677278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:13.678635 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:13.679271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:13.686462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-31fe81be-008c-47be-b208-d5bc01096af6 req-d39b6485-0aee-4049-89ca-181f9323615e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.687293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-31fe81be-008c-47be-b208-d5bc01096af6 req-d39b6485-0aee-4049-89ca-181f9323615e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.697531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.698045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.700506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:13.700506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:13.701922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-31fe81be-008c-47be-b208-d5bc01096af6 req-d39b6485-0aee-4049-89ca-181f9323615e service nova] Creating event network-changed:7996838c-af81-4f6b-8afa-9b8a7c826137 for instance 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 on hv-cinder-xena0 Jan 05 18:07:13.706974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-31fe81be-008c-47be-b208-d5bc01096af6 req-d39b6485-0aee-4049-89ca-181f9323615e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035236 Jan 05 18:07:13.708385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 45/84] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:13.965619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:13.982353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9a760e04-42cd-4861-bcec-75cb0877ee9e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.307259 Jan 05 18:07:13.982941 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 40/85] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:13 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:14.073555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-6548c328-dc6e-42b9-9455-9ceaeb31145e req-140368ec-7cbe-47fd-922a-be655698e8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43be7c20-103d-483f-99e6-62880b672333", "tag": "c12cd601-9200-451f-a797-41769529c4ce"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:14.075986 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:14.075986 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:14.083858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-6548c328-dc6e-42b9-9455-9ceaeb31145e req-140368ec-7cbe-47fd-922a-be655698e8e2 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:14.084287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-6548c328-dc6e-42b9-9455-9ceaeb31145e req-140368ec-7cbe-47fd-922a-be655698e8e2 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:14.095939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-6548c328-dc6e-42b9-9455-9ceaeb31145e req-140368ec-7cbe-47fd-922a-be655698e8e2 service nova] Creating event network-changed:c12cd601-9200-451f-a797-41769529c4ce for instance 43be7c20-103d-483f-99e6-62880b672333 on hv-cinder-xena0 Jan 05 18:07:14.101301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-6548c328-dc6e-42b9-9455-9ceaeb31145e req-140368ec-7cbe-47fd-922a-be655698e8e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036747 Jan 05 18:07:14.101935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 46/86] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:14.250519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:14.253234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:14.266333 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:14.267135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:14.268330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:14.269242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:14.462522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:14.477035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ad7a2827-6f91-4e42-951c-5cd73313a660 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.231293 Jan 05 18:07:14.486220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 41/87] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:14 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:14.592590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:14.594195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:14.603993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:14.604434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:14.608012 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:14.608494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:14.980540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:14.987855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5a798edc-0ac4-42d1-ade7-5d777aafb370 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.402987 Jan 05 18:07:14.988410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 47/88] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:14 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:14.999143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:14.999758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:15.006116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:15.006760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:15.007823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:15.008989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:15.206799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:15.219338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a51a0f95-3b36-4a23-aefa-748fd5ab561a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.223841 Jan 05 18:07:15.220903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 42/89] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:14 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:15.496301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:15.496943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:15.504447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:15.504947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:15.505843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:15.506316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:15.648036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:15.655713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1734cbd3-e06e-4662-b981-884043ef07d5 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.164103 Jan 05 18:07:15.656682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 48/90] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:15 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:16.004951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:16.005554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:16.027226 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.028076 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.029444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.032104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.222671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:16.231530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1d032932-077c-4445-ae8c-3ca09fb09741 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.230594 Jan 05 18:07:16.236190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:15 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:16.236796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:16.237327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:16.243452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.243902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.244730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.245106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.403896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:16.411908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a7732c21-c881-434d-a849-38d398f7053f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.179093 Jan 05 18:07:16.422544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 49/92] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:16 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:16.672798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:16.673505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:16.679183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.679637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.680612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:16.681050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:16.810702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:16.823387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eb007700-293b-4412-be5a-970b087b2c2b tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.148972 Jan 05 18:07:16.823387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 44/93] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:16 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:17.250126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:17.250126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:17.256062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.256523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.257299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.257734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.397872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:17.405436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4e0c63b0-fc22-4141-9673-1141398681a4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.159833 Jan 05 18:07:17.407162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 50/94] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:17 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:17.436841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:17.438649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:17.445229 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.446388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.447409 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.447972 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.597354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:17.606341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c646b3c8-243f-4d61-8454-f7048459c7a1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.179755 Jan 05 18:07:17.606970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 45/95] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:17 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:17.837199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:17.838147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:17.844153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.844886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.845863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:17.846515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:17.972826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:17.980664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6ab259aa-e506-4e46-9b1a-da9038ad2695 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.147857 Jan 05 18:07:17.981261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:17 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:18.425743 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:18.426542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:18.434219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:18.434669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:18.435916 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:18.436512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:18.572717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:18.580376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d923002e-4d19-478f-ba2f-4a088d32ce98 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.158437 Jan 05 18:07:18.581056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 46/97] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:18 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:18.623407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:18.627910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:18.630002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:18.630692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:18.631688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:18.632316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:18.818885 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:18.831171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6c812296-c26e-4523-981b-b402e1753c4b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.209265 Jan 05 18:07:18.840841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 52/98] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:18 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:18.997273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:18.997882 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:19.004541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.005173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.006250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.006842 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.174175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:19.182314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5a0908a1-6346-45c4-a5a2-1b5063bdc3b2 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.188653 Jan 05 18:07:19.183112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:18 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:19.596302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:19.597259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:19.605640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.606545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.607766 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.608559 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.823772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:19.830968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b05fae24-729f-494d-ba99-ece8588eb5ec tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.238325 Jan 05 18:07:19.831579 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 53/100] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:19 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:19.848033 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:19.848889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:19.855821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.856275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.857233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:19.857677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:19.983680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:19.993223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c2044ab6-d8e6-459f-888b-34f7ae9eea1f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.148062 Jan 05 18:07:19.995234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 48/101] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:19 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:20.201645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:20.202590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:20.209801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:20.210287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:20.211123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:20.211564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:20.397672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:20.410097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0e3084e7-1d0b-4614-ad44-ff20838b3ba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.211367 Jan 05 18:07:20.415421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 54/102] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:20 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:20.855123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:20.855807 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:20.861893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:20.862536 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:20.863375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:20.863808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:20.984022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:20.992166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-77f2ef54-a74a-4fb3-876c-40fa2cc6be6a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.146321 Jan 05 18:07:20.993379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 49/103] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:20 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:21.011465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:21.012323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:21.018295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:21.018745 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:21.019705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:21.020146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:21.147509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:21.155870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8c30dd98-0556-4be7-9c05-773cc541f6e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.148065 Jan 05 18:07:21.157039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 55/104] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:21 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:21.424457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:21.425070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:21.431094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:21.431547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:21.432328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:21.432956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:21.565689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:21.588660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-61a78cd8-f2cd-4ab9-92bf-a07daf0a0ca8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.167774 Jan 05 18:07:21.591612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 50/105] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:21 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:21.890085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-15699380-2e9e-4bf7-9b4b-11650ec08f4b req-10ae5a5f-fe3c-4262-8383-8eb89b9a8a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5d27f4-8ffb-42ff-828c-93226d23a340", "name": "network-vif-plugged", "status": "completed", "tag": "fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:21.892269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:21.892269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:21.900410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-15699380-2e9e-4bf7-9b4b-11650ec08f4b req-10ae5a5f-fe3c-4262-8383-8eb89b9a8a35 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:21.900850 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-15699380-2e9e-4bf7-9b4b-11650ec08f4b req-10ae5a5f-fe3c-4262-8383-8eb89b9a8a35 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:21.913088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-15699380-2e9e-4bf7-9b4b-11650ec08f4b req-10ae5a5f-fe3c-4262-8383-8eb89b9a8a35 service nova] Creating event network-vif-plugged:fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c for instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 on hv-cinder-xena0 Jan 05 18:07:21.919400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-15699380-2e9e-4bf7-9b4b-11650ec08f4b req-10ae5a5f-fe3c-4262-8383-8eb89b9a8a35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106615 Jan 05 18:07:21.920195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 56/106] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:22.009416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:22.010608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:22.025274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.025274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.025274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.025274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.177127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:22.178410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:22.198623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.199085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.199900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.200334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.245160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:22.252352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bd78cf03-a740-449b-9c87-35b6cbb4e862 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.247607 Jan 05 18:07:22.260230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:22 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:22.400403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:22.408290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3409d9fb-c534-4a1d-90a1-e585a33fcfce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.236776 Jan 05 18:07:22.409384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:22 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:22.605801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:22.606799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:22.614200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.614200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.614678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:22.615362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:22.765495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:22.776573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-45f92942-0034-469b-8bda-4fc2c7538e88 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.175500 Jan 05 18:07:22.778636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 52/109] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:22 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:23.270577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:23.271729 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:23.278280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.278924 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.279848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.280429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.410386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:23.418177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-eeb2d8e8-f7c3-49f7-8767-15956d356a1c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.151196 Jan 05 18:07:23.418748 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 58/110] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:23 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:23.426523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:23.427678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:23.436979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.436979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.436979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.436979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.584336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:23.598968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-deef6a4e-22ca-4c68-98dc-ebb55b411230 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.175849 Jan 05 18:07:23.599689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 53/111] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:23 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:23.797255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:23.798401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:23.805071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.805782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.806815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.808223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:23.951290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:23.952270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ddb291a-0f29-4cc4-8030-63b5c9bad269", "name": "network-vif-plugged", "status": "completed", "tag": "df48552c-b3ac-4d6c-9e6d-2d520990ed4f"}, {"server_uuid": "43be7c20-103d-483f-99e6-62880b672333", "name": "network-vif-plugged", "status": "completed", "tag": "c12cd601-9200-451f-a797-41769529c4ce"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:23.954856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:23.954856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:07:23.961463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-60137d4a-e0df-4902-be3c-327d6cd8b01a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.165705 Jan 05 18:07:23.965494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 59/112] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:23 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:23.980047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:23.980613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.003402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Creating event network-vif-plugged:df48552c-b3ac-4d6c-9e6d-2d520990ed4f for instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 on hv-cinder-xena0 Jan 05 18:07:24.003926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Creating event network-vif-plugged:c12cd601-9200-451f-a797-41769529c4ce for instance 43be7c20-103d-483f-99e6-62880b672333 on hv-cinder-xena0 Jan 05 18:07:24.004458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-5a7fcf9b-6ea3-48a2-a7dc-e70fcaf8fe0e req-a64e578f-c9b9-46c9-b482-a1731796ccc6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116429) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jan 05 18:07:24.005590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.006075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.006884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.007338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.017069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.compute.rpcapi [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 05 18:07:24.018004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] Releasing lock "compute-rpcapi-router" {{(pid=116429) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jan 05 18:07:24.038976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-14f21ba7-d1b8-450d-af9c-641d9eaca702 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090839 Jan 05 18:07:24.042307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 54/113] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:24.435174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:24.435778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:24.441847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.442323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.443336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.443909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.616196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:24.617423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:24.630362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.630813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.631583 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.632167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.670441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:24.677721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-de30e1a2-4013-4343-8879-f0d01adcef4b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.246133 Jan 05 18:07:24.678327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 60/114] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:24 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:24.787196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:24.794969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-19360ba1-b11d-4780-9bb2-10e2df335398 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.183054 Jan 05 18:07:24.799094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:24 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:24.978173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:24.978776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:24.984377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.984959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:24.985566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:24.985990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:25.168179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:25.181681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e267f0f2-058a-4ad6-b91a-50fb173c6554 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1314 microversion: 2.1 time: 0.207043 Jan 05 18:07:25.183250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 61/116] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:24 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:25.694893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:25.696015 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:25.701719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:25.702209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:25.703019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:25.703474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:25.812652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:25.813834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:25.819815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:25.821050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:25.821977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:25.822466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:25.825021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:25.832977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-dc85cfa9-9a5a-409c-8aab-6f62eec7ba80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.141135 Jan 05 18:07:25.834069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 56/117] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:25 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:25.952493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:25.960357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c9061bd3-9a09-410c-97ba-f5d3e9bb9507 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.151494 Jan 05 18:07:25.961510 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 62/118] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:25 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:26.057933 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-277b8b6b-50bc-4d10-919c-357e0cb34e8b req-b22241bc-1ecc-41bd-950f-e8f3ee0804a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc46c6-cb73-4f7e-806b-4e68fdf9c293", "name": "network-vif-plugged", "status": "completed", "tag": "7996838c-af81-4f6b-8afa-9b8a7c826137"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:26.059591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:26.059591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:07:26.066610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-277b8b6b-50bc-4d10-919c-357e0cb34e8b req-b22241bc-1ecc-41bd-950f-e8f3ee0804a3 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.067085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-277b8b6b-50bc-4d10-919c-357e0cb34e8b req-b22241bc-1ecc-41bd-950f-e8f3ee0804a3 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.085519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-277b8b6b-50bc-4d10-919c-357e0cb34e8b req-b22241bc-1ecc-41bd-950f-e8f3ee0804a3 service nova] Creating event network-vif-plugged:7996838c-af81-4f6b-8afa-9b8a7c826137 for instance 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 on hv-cinder-xena0 Jan 05 18:07:26.092996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-277b8b6b-50bc-4d10-919c-357e0cb34e8b req-b22241bc-1ecc-41bd-950f-e8f3ee0804a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039282 Jan 05 18:07:26.093690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 57/119] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:07:26.199312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:26.199916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:26.205647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.206138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.206907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.207336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.361239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:26.369816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-98ad6596-65d5-460a-ba86-f3f5a835bffa tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1501 microversion: 2.1 time: 0.174699 Jan 05 18:07:26.371203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 63/120] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:26 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:26.852064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:26.852839 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:26.859057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.859510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.860286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.860727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.978693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:26.979316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:26.988946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.989412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:26.990235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:26.990841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:27.048255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:27.056045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9a934c22-fb26-4050-b605-8328ef17c999 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.208834 Jan 05 18:07:27.056628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 58/121] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:26 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:27.168768 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:27.180753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7d95638f-3814-46fc-9a1f-cdf4c16bc4f3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1361 microversion: 2.1 time: 0.205423 Jan 05 18:07:27.181352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 64/122] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:26 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:28.073166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:28.073789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:28.082860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.083309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.084084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.084520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.197448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:28.198543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:28.207192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.207777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.208636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.209232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.254001 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:28.262070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bc323890-6f5b-4e51-90fe-4ea99c8ededd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.192613 Jan 05 18:07:28.270241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 59/123] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:28 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:28.362252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:28.369983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7bc612a7-e263-400f-a737-ab466ff2f849 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1546 microversion: 2.1 time: 0.177042 Jan 05 18:07:28.370574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 65/124] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:28 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:28.386572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:28.387063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:28.392746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.393232 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.393985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:28.394446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:28.515110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-90b540ef-12ee-4269-92c8-34c076e80c0c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132419 Jan 05 18:07:28.515712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jan 5 18:07:28 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:07:29.278689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:29.279409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:29.289548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:29.293551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:29.294633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:29.295152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:29.510248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:29.518286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-be997212-f9cf-43fb-bddd-9291c1cc427f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.243594 Jan 05 18:07:29.518868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 66/126] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:29 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:30.082759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:30.087375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:30.087680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-a4f232f1-df07-4048-b0d0-6fa89f19e94a req-a89aa5dc-0449-4e3a-99f0-4b15ef46e40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43be7c20-103d-483f-99e6-62880b672333", "tag": "c12cd601-9200-451f-a797-41769529c4ce"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:30.089396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:07:30.089396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:07:30.091373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:30.092117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:30.093193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:30.094173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:30.102459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-a4f232f1-df07-4048-b0d0-6fa89f19e94a req-a89aa5dc-0449-4e3a-99f0-4b15ef46e40c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:30.102902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-a4f232f1-df07-4048-b0d0-6fa89f19e94a req-a89aa5dc-0449-4e3a-99f0-4b15ef46e40c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:30.131107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-a4f232f1-df07-4048-b0d0-6fa89f19e94a req-a89aa5dc-0449-4e3a-99f0-4b15ef46e40c service nova] Creating event network-changed:c12cd601-9200-451f-a797-41769529c4ce for instance 43be7c20-103d-483f-99e6-62880b672333 on hv-cinder-xena0 Jan 05 18:07:30.142476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-a4f232f1-df07-4048-b0d0-6fa89f19e94a req-a89aa5dc-0449-4e3a-99f0-4b15ef46e40c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058979 Jan 05 18:07:30.144685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 67/127] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:07:30.535744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:30.536638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:30.542617 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:30.542995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:30.543757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:30.544360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:30.713593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:30.723301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-844270c3-9afb-4ade-a99b-95a81983e810 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.191413 Jan 05 18:07:30.726033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 68/128] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:30 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:31.742676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:31.743635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:31.754259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:31.755197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:31.757927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:31.758560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:31.965155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d1f1664b-29f4-40cd-afa7-c8cd475d5086 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 14 microversion: 2.1 time: 1.885957 Jan 05 18:07:31.965931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 61/129] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:30 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 14 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 18:07:32.041730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:32.051319 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d5d93726-1820-40a9-8114-3eb4a18b0ea4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1322 microversion: 2.1 time: 0.313823 Jan 05 18:07:32.062484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 69/130] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:31 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:32.977710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:32.978797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:32.986064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:32.986544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:32.987315 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:32.987752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:33.010813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd3d3abc-fa3b-43ce-a65a-ab6cd8143a27"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:33.011903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:33.017732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:33.018220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:33.019004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:33.019437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.345155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6966b30e-5bc3-4f0f-9f77-4318525335cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 14 microversion: 2.1 time: 3.372181 Jan 05 18:07:36.345790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 62/131] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:32 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 14 bytes in 3374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:07:36.351737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:36.352742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:36.359281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.359731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.360592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.361056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.494691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:36.501808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-acd236cc-f478-4502-9fd8-acad97e6a39c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1515 microversion: 2.1 time: 0.155008 Jan 05 18:07:36.502461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 63/132] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:36 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:36.519533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:36.520451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:36.527524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.527975 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.528751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.529187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.552568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'flavor' on Instance uuid 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:07:36.875479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8760c776-3fe7-499e-b707-10d35e32e646 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293/action" status: 200 len: 32 microversion: 2.1 time: 0.359444 Jan 05 18:07:36.876024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 64/133] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:36 2022] POST /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 18:07:36.885329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:36.886007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:36.892355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.892793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.893551 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:36.893979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:36.963853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8e1c1b54-8748-4dc9-a59a-be788fdbc468 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "POST /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.956600 Jan 05 18:07:36.964446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 70/134] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:07:33 2022] POST /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340/os-volume_attachments => generated 194 bytes in 3958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:07:37.198672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:37.206606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-afed95cd-cda9-43b2-9f58-18900642c349 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.325132 Jan 05 18:07:37.207188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:36 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:37.356550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:37.357612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:37.364424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:37.365122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:37.366270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:37.367345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:37.750307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f086bc58-1bc1-4ad9-a2c4-63223270624f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 14 microversion: 2.1 time: 0.397705 Jan 05 18:07:37.751060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 71/136] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:37 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 14 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:07:38.225286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:38.225974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:38.232747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:38.233331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:38.234286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:38.234811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:38.361097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:38.368322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-94fd09cc-8e1b-4634-8bbb-b0e4de346ba1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.147321 Jan 05 18:07:38.368891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 66/137] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:38 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:38.762760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:38.943724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:38.943724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:38.943724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:38.943724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:38.945222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:38.945222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a1b73e25-7f8b-4e05-8a23-6b35ef199b02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 14 microversion: 2.1 time: 0.158338 Jan 05 18:07:38.945222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 72/138] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:38 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:07:39.384690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:39.385995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:39.391163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:39.391621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:39.392390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:39.392823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:39.513777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:39.521138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f6a60b33-54d7-4958-8ce3-8c5a32d1066b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.140188 Jan 05 18:07:39.529207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 67/139] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:39 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:39.928260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:39.929331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:39.935948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:39.936406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:39.937209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:39.937643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:40.049475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1465e569-1c5d-4018-99c0-68f1f0f110fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 3437 microversion: 2.1 time: 0.125172 Jan 05 18:07:40.052752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 73/140] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:39 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 3437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:40.537802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:40.539508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:40.545134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:40.545577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:40.546363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:40.546791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:40.680375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:40.689969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-492c05ef-520c-46b4-b29e-81424fb8e827 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.155739 Jan 05 18:07:40.690576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 68/141] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:40 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:41.060362 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:41.061360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:41.067939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:41.068388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:41.069160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:41.069770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:41.706069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:41.706674 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:41.713247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:41.713688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:41.714711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:41.715138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:41.860031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:41.868017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-84cbbb86-caac-4f36-9da7-cc12fec1aff4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.165563 Jan 05 18:07:41.868606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 69/142] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:41 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:42.885354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:42.885938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:42.891628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:42.892068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:42.892828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:42.893261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:43.019084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:43.027416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cc2b1823-7690-45e4-b3b4-34d3f6dfdb06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.146038 Jan 05 18:07:43.027924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 70/143] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:42 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:43.830223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6b4913f1-1ee3-4902-9b9b-4a2d8f8fb200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 18083 microversion: 2.1 time: 2.773739 Jan 05 18:07:43.831335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 74/144] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:41 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 18083 bytes in 2776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:44.043295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:44.043899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:44.051179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:44.051179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:44.051382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:44.051795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:44.181219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:44.188687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-daaa6641-af17-4178-954f-ecb72db1d022 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.149038 Jan 05 18:07:44.191320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 71/145] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:44 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:44.843254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:44.843254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:44.848933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:44.849378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:44.850193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:44.850991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:45.206183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:45.206870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:45.214499 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:45.214989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:45.215755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:45.216302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:45.343553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:45.352292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-21ffbe22-2ff8-4c36-9a51-c5255685a34c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.149768 Jan 05 18:07:45.353003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 72/146] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:45 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:46.369333 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:46.369973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:46.375768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:46.376222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:46.377088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:46.377531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:46.499605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:46.508310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-88fcb613-23de-40c9-81d3-378fe78efed7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.142493 Jan 05 18:07:46.510619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 73/147] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:46 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:47.525172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:47.525783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:47.531543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:47.531988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:47.532760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:47.533201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:47.671018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:47.678417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a197aa7d-b25b-4f59-8163-997678568651 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.157642 Jan 05 18:07:47.678990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 74/148] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:47 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:48.253633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-58c241ae-2015-4ef5-8611-08d41abde463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 24383 microversion: 2.1 time: 3.416189 Jan 05 18:07:48.255534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 75/149] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:44 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 24383 bytes in 3418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:48.695285 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:48.696454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:48.702698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:48.703204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:48.703983 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:48.704421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:48.846945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:48.855118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e0bc367b-dc3f-4ae9-9605-1476ff4657ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.163334 Jan 05 18:07:48.855755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:48 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:49.266872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:49.267782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:49.274058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:49.274592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:49.275304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:49.275730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:49.413771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-eb51c25d-bf6d-41c8-bc69-ccff729cfdcd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 25570 microversion: 2.1 time: 0.150772 Jan 05 18:07:49.414739 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 76/151] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:49 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 25570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:49.871757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:49.872527 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:49.878766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:49.879385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:49.880529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:49.880968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:50.005573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:50.018603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ceac207d-5fd5-4fb7-b01b-ec17db3701ff tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.150350 Jan 05 18:07:50.019650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 76/152] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:49 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:50.428133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:50.429130 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:50.436741 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:50.437180 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:50.437942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:50.438398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:50.563560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e5c238e4-960d-4a9f-ab4f-e65992c72387 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 26520 microversion: 2.1 time: 0.139278 Jan 05 18:07:50.565599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 77/153] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:50 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 26520 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:51.035974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:51.036722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:51.042773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:51.043234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:51.044022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:51.044444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:51.164146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:51.171471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b7949592-3134-488a-ab38-edf3a5647e7a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.139214 Jan 05 18:07:51.172040 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 77/154] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:51 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:51.576688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:51.577778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:51.584079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:51.584634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:51.585396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:51.585825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:51.724343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-281ce9ea-2051-4922-b29f-5cdb207b11cd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27218 microversion: 2.1 time: 0.152216 Jan 05 18:07:51.725000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 78/155] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:51 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:52.187118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:52.187745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:52.193319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:52.193755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:52.194576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:52.195007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:52.319175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:52.326491 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7547d2c2-e20c-4c4a-98c0-4468c6de2287 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.142962 Jan 05 18:07:52.327054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:52 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:52.737047 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:52.738079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:52.745521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:52.746357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:52.747146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:52.747584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:52.886816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-30b136a6-f9ee-4b9b-9923-7853ce0c5844 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27626 microversion: 2.1 time: 0.153539 Jan 05 18:07:52.890686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 79/157] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:52 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27626 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:53.342911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:53.343511 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:53.349853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:53.350390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:53.351146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:53.351576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:53.471802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:53.480199 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2b27f568-287e-4bab-94fb-2c671af965df tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.140802 Jan 05 18:07:53.480802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:53 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:53.898442 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:53.899468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:53.906443 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:53.906885 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:53.907722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:53.908061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:54.497609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:54.500068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:54.504026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:54.504477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:54.505270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:54.505709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:54.661629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:54.670794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7a8b03da-1641-4538-8c21-b17b9eb2a1c2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.177672 Jan 05 18:07:54.679774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 80/159] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:54 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:55.688655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:55.689286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:55.695042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:55.695487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:55.704028 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:55.704028 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:55.816146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:55.827000 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c5ab9cd1-94ac-4c6d-b444-9055b5b68a05 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.142093 Jan 05 18:07:55.827653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 81/160] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:55 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:56.847372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:56.849742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:56.856144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:56.856599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:56.857393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:56.857995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:56.976266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:56.983887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-14e12648-0b9d-40a6-abe6-120c8b1e2435 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.140135 Jan 05 18:07:56.984452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 82/161] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:56 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:58.000112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:58.000789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:58.006575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:58.008496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:58.009902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:58.010368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:58.129208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:58.137086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-811c1d7b-1bdd-4d28-b14a-b7fb974fc99d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.140552 Jan 05 18:07:58.138049 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 83/162] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:57 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:07:58.390601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-19fc720b-0755-44b5-93bd-08922756c3d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27794 microversion: 2.1 time: 4.495881 Jan 05 18:07:58.391185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 80/163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:53 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27794 bytes in 4498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:07:59.154305 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:07:59.155529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:59.161216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:59.161651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:59.162438 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:59.162867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:59.285996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:07:59.294984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-42c44d13-27f8-4def-9abc-18b7e8ad3c48 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.144968 Jan 05 18:07:59.296632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 84/164] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:07:59 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:07:59.402952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:07:59.403934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:07:59.410350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:59.410732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:59.411489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:07:59.411915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:07:59.513824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-80db2b2d-b92d-4013-a9aa-9228e9a608a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27794 microversion: 2.1 time: 0.115058 Jan 05 18:07:59.514509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 81/165] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:07:59 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27794 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:00.312974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:00.313732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:00.319865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:00.320313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:00.321097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:00.321538 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:00.455271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:00.462593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b6e89643-8304-4335-b68c-896b5cff1866 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.153297 Jan 05 18:08:00.463183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:00 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:00.525924 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:00.527061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:00.534720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:00.535203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:00.536090 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:00.536550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:00.675367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ad9e26f4-5fd4-4dc3-a65b-0a2310841cb0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27921 microversion: 2.1 time: 0.153392 Jan 05 18:08:00.676021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 82/167] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:00 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27921 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:01.177288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-813024662", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "6ea5c4df-8b0d-4950-b450-970791c55261"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:01.228239 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] validate_networks() for [('6ea5c4df-8b0d-4950-b450-970791c55261', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:08:01.480430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:01.481125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:01.487463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.487848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.488616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.497792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.586720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:08:01.587196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:08:01.587642 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:08:01.588077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:08:01.589250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:08:01.598564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.599356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.600178 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.602339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.611643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:01.618995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-64a2b171-ce86-4a99-8a88-4e4879e05263 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.142764 Jan 05 18:08:01.619555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 83/168] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:01 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:01.621320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Getting quotas for project bc13c6223d1445e0979009edce8585a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:08:01.626142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Getting quotas for user 3f5604b6125c4301aab55b63694331c1 and project bc13c6223d1445e0979009edce8585a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:08:01.637784 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:08:01.640171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:08:01.687746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:01.688897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:01.694849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.695295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.696065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:01.696498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:01.788115 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8fe32aa0-0169-4a3b-a9cd-5ea7405a4f36 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614357 Jan 05 18:08:01.788758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 86/169] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:08:01.798652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7d539cb4-b482-4e2a-a2b3-7b698e227086 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:01.799241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7d539cb4-b482-4e2a-a2b3-7b698e227086 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:01.802290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-989da279-eafc-41cc-89d0-b90164825d88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 27972 microversion: 2.1 time: 0.117991 Jan 05 18:08:01.804158 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 84/170] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:01 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 27972 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:01.850909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7d539cb4-b482-4e2a-a2b3-7b698e227086 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:01.857545 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7d539cb4-b482-4e2a-a2b3-7b698e227086 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1218 microversion: 2.1 time: 0.062337 Jan 05 18:08:01.858157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 87/171] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:01 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:02.802728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:02.802728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:02.802728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:02.802728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:02.803384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:02.803384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:02.803384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:02.803667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e311471-50ae-4539-95af-029cae44ba30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.148522 Jan 05 18:08:02.803667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 85/172] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:02 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:02.814312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:02.815280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:02.821528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:02.821971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:02.822765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:02.824256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:02.874511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d6ded411-612b-4d90-a810-6bec21a37c1f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:02.875142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d6ded411-612b-4d90-a810-6bec21a37c1f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:02.928978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d6ded411-612b-4d90-a810-6bec21a37c1f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:02.935598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d6ded411-612b-4d90-a810-6bec21a37c1f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1218 microversion: 2.1 time: 0.064736 Jan 05 18:08:02.936164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:02 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:02.941238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-465dbc90-81bc-4775-ae10-3270c7f9e377 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28039 microversion: 2.1 time: 0.130325 Jan 05 18:08:02.945206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 88/174] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:02 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28039 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:03.362425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:03.363005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:03.368914 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.369361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.370191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.371215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.401176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:08:03.735487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3b9fe843-f64d-4b37-950d-d0ae18f5b1dc tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 204 len: 0 microversion: 2.1 time: 0.376441 Jan 05 18:08:03.736038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 87/175] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:08:03 2022] DELETE /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:08:03.744434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:03.745166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:03.752589 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.753032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.753807 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.754262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.797915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:03.798643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:03.804301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.804899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.805498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.805932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.877621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:03.885850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-908347dd-270e-4d24-92a5-35b189be5fa1 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.145306 Jan 05 18:08:03.886560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 89/176] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:03 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:03.932170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:03.939403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6490bd30-584b-4896-998f-7495252af607 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.145746 Jan 05 18:08:03.939967 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:03 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:03.952200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:03.952418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:03.952801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:03.953319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:03.958597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.959043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.959154 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.959525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.959812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.960245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:03.960336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:03.960726 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:04.019154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:04.026262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-15a1137d-c2af-4b70-bd94-b3ce2f8bf6d2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.077530 Jan 05 18:08:04.027320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 89/178] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:03 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:04.903314 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:04.903906 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:04.909978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:04.910456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:04.911224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:04.911660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:05.029780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:05.037404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0ec843cb-cafc-439b-8cf6-03516b37fba3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.137897 Jan 05 18:08:05.037981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 90/179] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:04 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:05.048055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:05.048660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:05.054535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:05.054991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:05.055760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:05.056197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:05.179526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:05.187232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5f970d70-bfa6-41a4-955f-f5a16bc403f1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.142807 Jan 05 18:08:05.187855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 91/180] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:05 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:05.191949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:05.192539 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:05.198033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:05.198508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:05.200005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:05.200432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:05.261099 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:05.268811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e633397d-90d9-4c33-ac93-d78773588bb8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.080085 Jan 05 18:08:05.269372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 92/181] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:05 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:06.054342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:06.054972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:06.060777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.061222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.062039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.062477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.180563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:06.189169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-348fa03e-70b0-4ef6-828d-04e8e5e8c4fe tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.138404 Jan 05 18:08:06.189732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 93/182] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:06 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:06.203847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:06.204477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:06.210340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.210877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.211713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.212222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.332289 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:06.340219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c6e9d0dd-fc76-4f10-bda3-c6018d9cb737 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.139753 Jan 05 18:08:06.340933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 94/183] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:06 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:06.345082 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:06.349387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:06.351395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.351836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.352593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:06.353023 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:06.412048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:06.420055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e60240c9-9519-47f7-be37-6672f9099986 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.078192 Jan 05 18:08:06.420606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 95/184] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:06 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:07.205635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:07.206311 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:07.212534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.212977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.213730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.214190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.333078 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:07.340563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-969f9701-f159-4ebb-82a9-4bd02385b22c tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.138509 Jan 05 18:08:07.341114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 96/185] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:07 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:07.356747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:07.357334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:07.363169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.363996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.364943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.365370 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.490390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:07.498390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8046da1e-07f5-4191-ab47-cb06c072fc8e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.145873 Jan 05 18:08:07.498948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 97/186] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:07 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:07.504511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:07.505117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:07.510911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.511404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.512171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:07.512604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:07.573737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:07.581135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9e508c26-9496-42b5-912a-1fb9b519eea2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.081257 Jan 05 18:08:07.581686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 98/187] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:07 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:08.357386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:08.357996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:08.363867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.367116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.367116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.367116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.483273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:08.491670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cd492f09-7826-4b9e-96bb-2a3a1d7a10df tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.138147 Jan 05 18:08:08.492250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 99/188] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:08 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:08.515649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:08.516237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:08.522168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.522623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.523402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.523839 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.652830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:08.660033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b530112d-2005-4c2f-bf44-a0dabb30abbe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.148970 Jan 05 18:08:08.660589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 100/189] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:08 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:08.664658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:08.665246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:08.670557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.671073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.671827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:08.672254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:08.730977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:08.739150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4ed57370-3057-44ce-841e-a94b45c18c19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.077590 Jan 05 18:08:08.739718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 101/190] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:08 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:08.829712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ce57b627-a680-4404-9048-f7aab695e801 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.880776 Jan 05 18:08:08.830478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 90/191] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:03 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4882 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:09.509386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:09.510146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:09.516778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.517215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.518005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.518463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.641557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:09.649795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-74568551-7e7d-498f-b651-f642f8391717 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.144147 Jan 05 18:08:09.650397 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 102/192] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:09 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:09.676631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:09.677323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:09.683971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.684423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.685213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.685652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.758133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:09.758133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:09.763075 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.763565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.765177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.765536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.814935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:09.823066 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f9830583-ce43-49f5-a25a-b0dbee9bb765 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.150216 Jan 05 18:08:09.823790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 91/193] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:09 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:09.828007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:09.835899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-53ab3d82-b83d-4a61-8b6f-be3f51b9b2e8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.083035 Jan 05 18:08:09.836463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 103/194] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:09 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:09.841487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:09.842445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:09.848525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.849226 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:09.849988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:09.850453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.666920 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:10.667523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:10.674414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.674860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.675622 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.676055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.793404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:10.801968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dbc812af-cbef-4c39-bbc7-27735f01262a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.138612 Jan 05 18:08:10.802560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 104/195] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:10 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:10.839825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:10.840418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:10.846782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.847236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.847999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.848433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.967111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:10.975002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a54fe4b1-3d7c-4293-a483-feee39b6a965 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.138507 Jan 05 18:08:10.975555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 105/196] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:10 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:10.979610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:10.980199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:10.985545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.985984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:10.986758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:10.987177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:11.043758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:11.050807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ecd34a0e-edaa-46d0-9d7b-a3c8dfb4de16 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1270 microversion: 2.1 time: 0.074337 Jan 05 18:08:11.051365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 106/197] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:10 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1270 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:11.137396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1fc029d1-1a04-4df1-920e-885b054bc8f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 1.299803 Jan 05 18:08:11.141930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 92/198] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:09 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:08:11.818460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:11.819051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:11.825117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:11.825555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:11.826335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:11.826766 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:11.992237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:11.992934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:12.001591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.002294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.003078 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.003564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.028981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:12.038238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6fad4cb2-3298-41c4-a21b-b41dd449907a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.223227 Jan 05 18:08:12.047671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 107/199] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:11 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:12.068862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:12.069707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:12.075968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.080415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.080415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.080415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.141531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:12.146971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:12.149779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a683bf7-d8c7-4fef-9e86-335530f3e015 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.161076 Jan 05 18:08:12.150870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 93/200] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:11 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:12.161477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:12.166612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:12.167005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-334101a3-7b04-4c95-998c-63f1cbb3aec2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1288 microversion: 2.1 time: 0.102211 Jan 05 18:08:12.168757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 108/201] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:12 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:12.170542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.171844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.173021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:12.173624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:12.309090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-14596ac6-6005-43c7-8c3d-54a0c582270f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.151212 Jan 05 18:08:12.309791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 94/202] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:12 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:13.054623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:13.055235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:13.060842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.061291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.063054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.063488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.167582 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:13.168357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:13.177033 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.177485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.178302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.178733 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.274172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:13.278191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ed4abd7c-ceb2-4f34-9619-72ac9c0f0355 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.227084 Jan 05 18:08:13.279293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 109/203] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:13 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:13.284746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:13.285487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:13.293200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.293651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.294477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.294915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.320002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:13.327661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-07953e1b-624f-45c0-9ed7-720a6332dfed tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.164012 Jan 05 18:08:13.328361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 95/204] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:13 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:13.332839 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:13.334224 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:13.340295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.340739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.341507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.341942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.448685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:13.455864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-da43eb3a-4430-4b01-a561-18bba1ee70ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.175394 Jan 05 18:08:13.456672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 110/205] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:13 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:13.497163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-06873943-58ab-411c-b749-37513e40ce1e req-44047f39-7021-4a50-b88f-516b0a0bf36c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b66edc-e5bc-4b66-8a5c-a28a8de81c7f", "tag": "40c6629f-ad64-4cb1-b51a-e4b9b5b708e5"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:13.498765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:08:13.498765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:08:13.506081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-06873943-58ab-411c-b749-37513e40ce1e req-44047f39-7021-4a50-b88f-516b0a0bf36c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:13.506518 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-06873943-58ab-411c-b749-37513e40ce1e req-44047f39-7021-4a50-b88f-516b0a0bf36c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:13.517407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-06873943-58ab-411c-b749-37513e40ce1e req-44047f39-7021-4a50-b88f-516b0a0bf36c service nova] Creating event network-changed:40c6629f-ad64-4cb1-b51a-e4b9b5b708e5 for instance 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f on hv-cinder-xena0 Jan 05 18:08:13.522444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-06873943-58ab-411c-b749-37513e40ce1e req-44047f39-7021-4a50-b88f-516b0a0bf36c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028749 Jan 05 18:08:13.523039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 111/206] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:08:14.296737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:14.297476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:14.304978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.304978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.304978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.304978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.428444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:14.436270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7b54c591-5043-4e6b-8d57-3bbcb1bef5c3 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.143893 Jan 05 18:08:14.436959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 112/207] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:14 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:14.441216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:14.441815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:14.447576 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.448018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.448784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.449214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.575069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:14.582155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-da73ec71-51e6-42c0-a7de-06f1036480c0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.144238 Jan 05 18:08:14.582717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 113/208] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:14 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:14.586791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:14.587378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:14.592506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.593462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.594255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:14.594680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:14.713487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:14.722352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d098f00a-37ee-4ed0-9b25-bcb04a32cfd6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.138554 Jan 05 18:08:14.722935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 114/209] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:14 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:15.453691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:15.454342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:15.460538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.461041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.461786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.462253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.577114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:15.585341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-62d3331d-c572-4012-9fbf-2b70be578653 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.135338 Jan 05 18:08:15.585905 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 115/210] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:15 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:15.598864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:15.599476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:15.604841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.605286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.606060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.606496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.725239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:15.732280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bd4a8f59-77aa-46c1-b8fe-e60dca755e03 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.137609 Jan 05 18:08:15.732841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 116/211] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:15 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:15.738612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:15.739199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:15.744941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.745391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.746343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:15.746776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:15.862778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:15.870195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5ef0cd50-0f49-459e-93da-0cd87dde4370 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.134925 Jan 05 18:08:15.870896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 117/212] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:15 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:16.602281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:16.602884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:16.608582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.609104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:16.609822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.610282 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:16.726947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:16.734457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-25cbfd5f-ce33-4469-8927-7eac117a9783 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.136098 Jan 05 18:08:16.735018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 118/213] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:16 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:16.747801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:16.748387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:16.754311 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.754749 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:16.755523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.756036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:16.875660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:16.883639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f27e7837-b86f-46f6-bb96-6f8db0250a57 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.139144 Jan 05 18:08:16.884208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 119/214] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:16 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:16.888332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:16.888921 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:16.894678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.895118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:16.895906 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:16.896337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:17.010311 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:17.017252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1628cd12-832c-4d92-900a-0d55b0bdf11a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.132122 Jan 05 18:08:17.017949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 120/215] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:16 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:17.487348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3566e4bc-38ce-40c2-a018-51176d4a33ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.156481 Jan 05 18:08:17.488045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 96/216] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:13 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:17.751617 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:17.752439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:17.758197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:17.758643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:17.759408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:17.759843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:17.881934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:17.889557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-78c0c5df-be52-4a90-8b64-2fce79b75349 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.141609 Jan 05 18:08:17.890138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 121/217] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:17 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:17.899647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:17.900373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:17.906710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:17.907160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:17.907984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:17.909129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.028272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:18.035194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:18.035511 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a07b5c1-2771-4bf4-a2e6-5ed7d09c31d1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.139873 Jan 05 18:08:18.035949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:18.036050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 97/218] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:17 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:18.041792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.042277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.043047 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.043508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.158101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:18.165050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e754c4d7-caa4-4b04-93b7-272e1a490658 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.133826 Jan 05 18:08:18.165614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 122/219] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:18 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:18.499312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:18.500280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:18.507141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.510664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.510664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.510664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.660802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2f49f93e-b17a-4b85-9135-0c42181053a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.165556 Jan 05 18:08:18.664718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 98/220] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:18 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:18.906853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:18.907587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:18.914349 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.914804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:18.915577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:18.916008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.046849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:19.055903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1e787734-e5ac-4418-b189-f6ea68c0c388 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1553 microversion: 2.1 time: 0.152777 Jan 05 18:08:19.056833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:19.056993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 123/221] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:18 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:19.058073 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:19.064655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.065370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.066298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.066827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.181310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:19.182006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:19.188765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.189413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.190461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.190957 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.195475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:19.203918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e08df898-945e-4d72-a220-3fa1d5fb23cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.154921 Jan 05 18:08:19.205740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 99/222] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:19 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:19.320079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:19.327782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d4166839-4c00-4350-b0c8-2dadbec12493 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.149829 Jan 05 18:08:19.336922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 124/223] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:19 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:19.671423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:19.672328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:19.679063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.679473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.680248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:19.680682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:19.773851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ebe876d0-5fbd-4b31-92e9-2835535e4574 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.105811 Jan 05 18:08:19.774698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 100/224] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:19 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:20.072334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:20.073092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:20.097425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.100974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.100974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.100974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.130433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-fbf67c24-3a8b-46d6-bb97-d90a503a1bfe req-8398a27b-60fb-466f-9fe4-1290a6aed7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5d27f4-8ffb-42ff-828c-93226d23a340", "name": "network-vif-deleted", "tag": "fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:20.131952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:08:20.131952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:08:20.144121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-fbf67c24-3a8b-46d6-bb97-d90a503a1bfe req-8398a27b-60fb-466f-9fe4-1290a6aed7e2 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.144558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-fbf67c24-3a8b-46d6-bb97-d90a503a1bfe req-8398a27b-60fb-466f-9fe4-1290a6aed7e2 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.155344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-fbf67c24-3a8b-46d6-bb97-d90a503a1bfe req-8398a27b-60fb-466f-9fe4-1290a6aed7e2 service nova] Creating event network-vif-deleted:fe304fa6-43fa-4138-a2ea-bbd8fd52ee6c for instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 on hv-cinder-xena0 Jan 05 18:08:20.160412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-fbf67c24-3a8b-46d6-bb97-d90a503a1bfe req-8398a27b-60fb-466f-9fe4-1290a6aed7e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Jan 05 18:08:20.161063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 101/225] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:08:20.161917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:20.169834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d98e77fb-fb34-46ec-8128-45e4e0dd8281 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1511 microversion: 2.1 time: 0.101138 Jan 05 18:08:20.170417 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 125/226] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:20 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:20.222680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:20.223451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:20.229754 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.230237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.232768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.232768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.344438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:20.345104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:20.351555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.352000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.352340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:20.352792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.353203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.359710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-659bca7a-e943-4ab7-93ab-21a0a5878c83 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.141504 Jan 05 18:08:20.360276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 102/227] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:20 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:20.471759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:20.479102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5a439424-55ab-4f4f-8ec0-40471e77e823 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.138321 Jan 05 18:08:20.479634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 126/228] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:20 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:20.785151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:20.786085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:20.791864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.792307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:20.793067 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:20.793500 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.187161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:21.187756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:21.194117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.194562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.195347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.195776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.255555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:21.263284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-67c601d2-71f1-429c-9ff0-ac7eee407d63 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1511 microversion: 2.1 time: 0.079830 Jan 05 18:08:21.265441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 127/229] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:21 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1511 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:21.377480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:21.378104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:21.383722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.384176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.384910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.385337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.504269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:21.511344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-443d1c2b-8485-4c15-b5e6-9fc7008f417d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.138195 Jan 05 18:08:21.511900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 128/230] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:21 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:21.516001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:21.516569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:21.522142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.522589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.523340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:21.523767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:21.639199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:21.646356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-44fd5f36-1941-4ad5-a556-22aac4822dc4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.133506 Jan 05 18:08:21.646908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 129/231] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:21 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:22.280424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:22.281069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:22.287712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.288155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.288917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.289349 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.346941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:22.354940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8e1b3b19-2aab-4167-bc1f-189c2d2a6764 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1511 microversion: 2.1 time: 0.078142 Jan 05 18:08:22.355494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 130/232] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:22 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1511 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:22.527990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:22.528630 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:22.534692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.535081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.535855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.536288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.655135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:22.662997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3de8da2d-e4d9-4b65-b2fe-51ad14982e0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.138723 Jan 05 18:08:22.663556 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 131/233] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:22 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:22.667823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:22.668418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:22.673690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.674277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.675608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:22.676043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:22.789571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:22.796758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-589c94ef-3402-4dcb-ba6b-47ca01124c0f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.132193 Jan 05 18:08:22.797325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 132/234] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:22 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:23.371578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:23.372195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:23.377929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.378472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.379378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.379811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.438506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:23.447227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-31c68dab-b448-422e-b25d-6ece80216b7a tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1345 microversion: 2.1 time: 0.079383 Jan 05 18:08:23.447851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 133/235] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:23 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:23.679170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:23.679769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:23.685656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.686136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.686899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.687396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.805724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:23.812948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-45f792c4-e3e2-409e-8fdc-5f99e5db19bf tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.137603 Jan 05 18:08:23.813503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 134/236] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:23 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:23.818460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:23.819050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:23.824339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.824783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.825538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:23.825970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:23.941942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:23.949030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-955abb44-9cc3-4a80-a6b0-9c921b3935d8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.134465 Jan 05 18:08:23.949593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 135/237] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:23 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:24.463834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:24.464465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:24.470375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.470822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:24.472722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.473290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:24.531736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:24.539875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-71280ec9-7ba8-4181-abac-45349fc5ed9d tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1345 microversion: 2.1 time: 0.079693 Jan 05 18:08:24.540440 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 136/238] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:24 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:24.829575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:24.830432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:24.836725 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.837176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:24.837947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.838412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:24.956501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:24.963780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b3cc32b0-58e2-453f-beae-a39bf90a9b41 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.137810 Jan 05 18:08:24.964345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 137/239] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:24 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:24.968539 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:24.969155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:24.974968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.975417 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:24.976177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:24.976604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:25.006418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b4a15d2f-cb91-421d-87d4-b14e999b687e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.225451 Jan 05 18:08:25.015783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 103/240] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:20 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:25.094178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:25.101580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-720b2a76-9bc7-48e1-ad21-0876870c6d7f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.136313 Jan 05 18:08:25.102158 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 138/241] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:24 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:25.556881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:25.557573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:25.563920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:25.564525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:25.566034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:25.566753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:25.626596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:25.634426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cfdf0a26-9587-4fc6-a2e4-b44385996fb8 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1345 microversion: 2.1 time: 0.081429 Jan 05 18:08:25.635105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 104/242] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:25 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:25.980267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:25.980978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:25.986846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:25.987293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:25.988060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:25.988490 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.025997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:26.026926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:26.032670 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.033236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.034524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.035134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.105230 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:26.112499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-55cd8c1a-81b8-4e4d-9f83-a13b3a9d5845 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.135956 Jan 05 18:08:26.113232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 139/243] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:25 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:26.117886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:26.118504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:26.123858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.124299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.125049 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.125477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.246864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:26.254507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d29c1c59-545e-4e4c-bc6a-e7443ce3c827 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.139781 Jan 05 18:08:26.255066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 140/244] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:26 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:26.269022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eba431d1-0925-42bc-8316-e424ff5a348d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.245744 Jan 05 18:08:26.269732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 105/245] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:26 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:08:26.650897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:26.651501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:26.657468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.657855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.658817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.659298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.690903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:26.691363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:26.691813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lazy-loading 'fault' on Instance uuid 1b5d27f4-8ffb-42ff-828c-93226d23a340 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:08:26.741178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:26.748218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d1c9b515-d839-40d4-b0e0-ee570c354191 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1350 microversion: 2.1 time: 0.100874 Jan 05 18:08:26.758679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 141/246] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:26 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:27.129092 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:27.129816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:27.136331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.136775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.137536 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.137969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.261440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:27.269041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9d1f30ca-45a8-4e93-94b9-167de93b2f86 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.143846 Jan 05 18:08:27.269714 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 106/247] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:27 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:27.271375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:27.277936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:27.282620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:27.284035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:27.284725 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.285407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.286331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.286770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.296456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.296912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.297695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.298287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.414123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:27.421299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bfeb7029-b2d4-407e-a32d-ecf84eb130f0 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.154270 Jan 05 18:08:27.421854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 142/248] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:27 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:27.765166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:27.765758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:27.772071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.772540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.773259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.773686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.802837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:27.803279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:27.803721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lazy-loading 'fault' on Instance uuid 1b5d27f4-8ffb-42ff-828c-93226d23a340 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:08:27.842359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ba972bae0194126ba14be44627e41eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2146dec079e43c6879b09741cb3e64f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:27.850041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8f8f6328-00fc-41f2-b0ce-e2b302a42ad6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 200 len: 1350 microversion: 2.1 time: 0.088390 Jan 05 18:08:27.850614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 143/249] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:27 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:27.961559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-64c1f9a8-03f6-43d7-8226-dae79159ecbb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.682345 Jan 05 18:08:27.965457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 107/250] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:27 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:28.287253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:28.287253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:28.292523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.293171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.293942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.294420 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.425654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:28.437777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-125322e9-21cf-42b9-9489-1fb22d928a73 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.155435 Jan 05 18:08:28.438620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 144/251] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:28 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:28.444739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:28.445540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:28.454418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.454883 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.455994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.456616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.614263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:28.621932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-31a2a843-e1cd-48a6-9c05-20a1990548e4 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.186606 Jan 05 18:08:28.622556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 108/252] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:28 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:28.866977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:28.867576 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:28.873091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.873550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.874343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.874774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.889001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] HTTP exception thrown: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. Jan 05 18:08:28.889649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Returning 404 to user: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:08:28.890554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fde02527-a398-460d-a2e6-c321db96f561 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 404 len: 111 microversion: 2.1 time: 0.027149 Jan 05 18:08:28.891395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 145/253] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:28 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:08:28.972591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:28.975815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:28.982962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.985119 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:28.986098 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:28.987575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.032395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:29.033424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:29.039192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.043111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.043111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.043111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.053507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] HTTP exception thrown: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. Jan 05 18:08:29.054118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Returning 404 to user: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:08:29.054928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-07f9f247-42e1-4c99-a163-1fd504b92de6 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.026242 Jan 05 18:08:29.055586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 146/254] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:08:29 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340/os-volume_attachments => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:08:29.162668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a0c2bae1-fe06-4cec-987d-dc9f22dd75ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.193220 Jan 05 18:08:29.163573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 109/255] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:28 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:29.455939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:29.456649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:29.464094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.464726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.465605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.466287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.603118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:29.615515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4d2759d6-9dd4-41d6-ace8-97299c892fa2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.158934 Jan 05 18:08:29.615515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 147/256] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:29 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:29.639587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:29.640333 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:29.647682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.648133 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.648909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:29.649346 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:29.793328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:29.800634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e8814d3d-8378-40c1-8ed8-13dd38fac4ec tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.165097 Jan 05 18:08:29.801193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 110/257] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:29 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:30.173987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:30.175608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:30.181319 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.181767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.182634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.183065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.627540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:30.628181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:30.633918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.634402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.635212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.635647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.771719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:30.781620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a943b34-5532-4bf2-85bb-7b8885ebdeb5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.157784 Jan 05 18:08:30.782233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 111/258] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:30 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:30.817503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:30.818408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:30.824645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.825088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.825866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:30.826330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:30.955055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:30.963230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e52fae71-44a0-4e84-be25-6f99c47cbe61 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.150212 Jan 05 18:08:30.963726 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 112/259] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:30 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:31.798527 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:31.799114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:31.806217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:31.806610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:31.807445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:31.807872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:31.930713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:31.937988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8ebfb3db-8be0-4b89-ae55-f0f072af5be7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.143028 Jan 05 18:08:31.938621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 113/260] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:31 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:31.979755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:31.980359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:31.986106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:31.986576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:31.987502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:31.987942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:32.109587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:32.117613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-67ee3ae1-11ac-4cb9-a05c-bf5944eccf48 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.141325 Jan 05 18:08:32.118208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 114/261] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:31 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:32.954650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:32.955290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:32.961515 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:32.961966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:32.962777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:32.963214 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:33.082985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:33.090406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d882b30-0f5b-49c8-9dd5-7a3301b3ac97 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.139523 Jan 05 18:08:33.091116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 115/262] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:32 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:33.133366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:33.133978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:33.139887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:33.140346 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:33.141259 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:33.141696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:33.275888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:33.283246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7d28bafe-b99e-4a3b-af53-03dc078a261a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.153393 Jan 05 18:08:33.284400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 116/263] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:33 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:34.109323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:34.110463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:34.117566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:34.118031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:34.118804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:34.119233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:34.244074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e15778b-630d-4146-8770-76cdb6f970ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.073509 Jan 05 18:08:34.247947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 148/264] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:30 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4076 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:34.248557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:34.262350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3f323f28-0980-4e47-b77f-b72d340b40e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1521 microversion: 2.1 time: 0.153358 Jan 05 18:08:34.262350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 117/265] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:34 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:34.301546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:34.302379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:34.308842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:34.309296 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:34.310094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:34.310537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:34.431216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:34.438436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e5f84b5-3f11-4c49-bf1d-964e55507d69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.141039 Jan 05 18:08:34.438988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 149/266] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:34 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:35.255655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:35.256523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:35.262331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.262774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.263540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.263970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.278606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:35.279217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:35.285789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.286418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.287395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.287841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.391238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a29a8f78-d128-42e4-876f-70c83fee3ba1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.139018 Jan 05 18:08:35.392170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 118/267] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:35 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:35.418327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:35.426435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0a276360-18c7-409b-9e84-7982e9af991b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1501 microversion: 2.1 time: 0.151445 Jan 05 18:08:35.427084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 150/268] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:35 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:35.442582 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:35.443289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:35.450242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.450702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.451468 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.451898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.457340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:35.457974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:35.463776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.464219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.465326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:35.466636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:35.576814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:35.586245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7d85f4d7-eb3e-4389-9ece-f20309cab1f6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1516 microversion: 2.1 time: 0.147593 Jan 05 18:08:35.586815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 119/269] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:35 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:35.600719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:35.608202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4e580e28-8c9f-46c6-a954-eaa53c925322 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.156810 Jan 05 18:08:35.608911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 151/270] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:35 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:36.402950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:36.403942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:36.410827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:36.411275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:36.412044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:36.412642 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:36.537210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-52466fb6-dd90-4fd9-94f6-7b4bfb0ddeed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.138222 Jan 05 18:08:36.537919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 120/271] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:36 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:36.630995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:36.631595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:36.637355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:36.637801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:36.638618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:36.639045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:36.756904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:36.764639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e9a0f51-ef9c-4507-b0fa-839e61dcbf3d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.137851 Jan 05 18:08:36.765307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 152/272] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:36 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:37.549625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:37.556115 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:37.557996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:37.558464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:37.559336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:37.559650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:37.695083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-348fbeb5-8739-419b-a872-2a67f2148c6d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.149743 Jan 05 18:08:37.698918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 121/273] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:37 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:37.781944 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:37.782569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:37.789561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:37.791570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:37.791570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:37.791570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:37.915670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:37.922896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-56126c44-6134-4f5e-9f51-f72636be2934 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.144447 Jan 05 18:08:37.923449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 153/274] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:37 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:38.274910 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:38.275489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.281973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.282280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.283041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.284048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.300132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] HTTP exception thrown: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. Jan 05 18:08:38.300750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Returning 404 to user: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:08:38.301586 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7f2ecea9-146e-49b4-8beb-5aebcf0179d9 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 404 len: 111 microversion: 2.1 time: 0.030658 Jan 05 18:08:38.302322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 122/275] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:08:38 2022] DELETE /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:08:38.310277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:38.311171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] [instance: 1b5d27f4-8ffb-42ff-828c-93226d23a340] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.317347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.317983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.319602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.325387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.339194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] HTTP exception thrown: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. Jan 05 18:08:38.339898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] Returning 404 to user: Instance 1b5d27f4-8ffb-42ff-828c-93226d23a340 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:08:38.340804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f82c62e3-df55-461b-b739-56013dc99c70 tempest-DeleteServersTestJSON-1501257176 tempest-DeleteServersTestJSON-1501257176-project] 10.222.0.26 "GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340" status: 404 len: 111 microversion: 2.1 time: 0.034291 Jan 05 18:08:38.341600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 154/276] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:38 2022] GET /compute/v2.1/servers/1b5d27f4-8ffb-42ff-828c-93226d23a340 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:08:38.387604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:38.388752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.394913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.395638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.396567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.397164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.431376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'flavor' on Instance uuid 4ddb291a-0f29-4cc4-8030-63b5c9bad269 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:08:38.512671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-07676996-47b2-4411-a121-ee25d1553d14 req-2741d415-15a0-4259-b83f-8c6a8ae9ec4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b66edc-e5bc-4b66-8a5c-a28a8de81c7f", "name": "network-vif-plugged", "status": "completed", "tag": "40c6629f-ad64-4cb1-b51a-e4b9b5b708e5"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:38.514587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:08:38.514587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:08:38.525900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-07676996-47b2-4411-a121-ee25d1553d14 req-2741d415-15a0-4259-b83f-8c6a8ae9ec4b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.526507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-07676996-47b2-4411-a121-ee25d1553d14 req-2741d415-15a0-4259-b83f-8c6a8ae9ec4b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.541285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-07676996-47b2-4411-a121-ee25d1553d14 req-2741d415-15a0-4259-b83f-8c6a8ae9ec4b service nova] Creating event network-vif-plugged:40c6629f-ad64-4cb1-b51a-e4b9b5b708e5 for instance 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f on hv-cinder-xena0 Jan 05 18:08:38.546477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-07676996-47b2-4411-a121-ee25d1553d14 req-2741d415-15a0-4259-b83f-8c6a8ae9ec4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037302 Jan 05 18:08:38.547280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 155/277] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:08:38.707732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:38.708848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.714836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.715287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.716058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.716495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.766892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7abc3256-6ba2-4f9b-99f4-50f5944bad9c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action" status: 200 len: 32 microversion: 2.1 time: 0.383062 Jan 05 18:08:38.768431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 123/278] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:38 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:08:38.777345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:38.778532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.787024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.787773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.788998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.789592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.852425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ea6edf63-b2e3-4fcf-92df-5b91e699f38d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.149326 Jan 05 18:08:38.853156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 156/279] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:38 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:08:38.914108 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:38.921665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-48b3a015-1fa9-4ed1-abd5-0a072dd76d96 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.148105 Jan 05 18:08:38.922262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 124/280] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:38 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:38.939693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:38.940386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:38.946879 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.947330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:38.948199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:38.948635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:39.246540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:39.254151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4435f0b5-34f2-4d0b-b747-f3f6b92373bf tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.318436 Jan 05 18:08:39.254712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 157/281] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:38 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:39.864974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:39.866864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:39.873245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:39.873765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:39.874654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:39.875163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:39.937851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:39.938513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:39.945344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:39.945784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:39.946574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:39.947013 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:39.998560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6cb64b97-a5fa-405e-bf53-63c5795467a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.138039 Jan 05 18:08:40.000895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 125/282] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:39 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:40.272189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:40.277773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:40.279520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:40.280186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:40.280987 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:40.281425 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:40.342765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:40.352474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-23257705-cb53-4d90-8a4f-dbc5d20eebab tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.418176 Jan 05 18:08:40.354351 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 158/283] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:39 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:40.444024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:40.451926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4c526375-0d00-4556-892a-cfd24767c6bb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.184531 Jan 05 18:08:40.452647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 126/284] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:40 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:41.014643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:41.014643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:41.046424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.047255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.052220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.052696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.368995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:41.370234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:41.376986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.377879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.378659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.379142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.504619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:41.511924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f4558a0f-4c5a-47c6-85c6-c64ba9f8bef4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.146943 Jan 05 18:08:41.512493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 127/285] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:41 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:41.525540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:41.526187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:41.531865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.532313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.533083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:41.534148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:41.653288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:41.663751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4dd6aa0c-1982-4232-9e64-94af996b1fae tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.141547 Jan 05 18:08:41.672986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 128/286] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:41 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:42.528233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:42.528873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:42.535273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:42.535729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:42.536502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:42.536941 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:42.679486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:42.687640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e1429ade-0aec-4b99-8c86-5092c7ffec10 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.162887 Jan 05 18:08:42.688694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 129/287] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:42 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:42.693228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:42.706114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:42.706114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:42.706114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:42.706114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:42.706752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:42.831557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:42.839118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac8479f1-408c-42ba-85da-bcec8c8e696c tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.149215 Jan 05 18:08:42.840492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 130/288] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:42 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:43.705130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:43.706692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:43.713954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:43.716523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:43.718052 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:43.720198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:43.926587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:43.934542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-41d3ab14-5b75-4a5d-9a4f-ebde9142b053 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.233166 Jan 05 18:08:43.934935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 131/289] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:43 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:43.944654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:43.944654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:43.947344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:43.947815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:43.951020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:43.951594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:44.113562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:44.121270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-dc77b783-ba5e-4fe8-b19f-faa8932ac364 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.185310 Jan 05 18:08:44.122151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 132/290] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:43 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:44.939064 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-32800238-7fec-4bd6-833a-5233b59a2c02 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 3.929701 Jan 05 18:08:44.941008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 159/291] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:41 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 3933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:44.956120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:44.956120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:44.977228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:44.977686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:44.979170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:44.979170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:45.139662 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:45.140791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:45.156439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:45.157229 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:45.162637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:45.163328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:45.381498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:45.390065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bf583a72-a6c4-48c8-91e5-110c554b4f79 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1318 microversion: 2.1 time: 0.254683 Jan 05 18:08:45.390973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 160/292] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:45 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:45.578320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:45.586081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e643c24e-a218-408d-9b79-1fec68e3c60f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.638277 Jan 05 18:08:45.586652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 133/293] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:44 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:45.952150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:45.954214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:45.960854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:45.961616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:45.962881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:45.963932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:46.065928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-893f3061-4ecf-47ad-91f9-08ab3dd10e96 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.117351 Jan 05 18:08:46.066614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 161/294] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:45 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:46.408513 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:46.409194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:46.422980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:46.428142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:46.428142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:46.428142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:46.605637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:46.610154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:46.622974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:46.626236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:46.628593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:46.629217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:46.711189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:46.719401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7a99ddbd-a8ea-4d53-b5b8-bfd0b32f78ca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1508 microversion: 2.1 time: 0.314790 Jan 05 18:08:46.747813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 134/295] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:46 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:46.838295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:46.849640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-537e7d79-919e-4ad0-b273-3b719e10eca1 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.250850 Jan 05 18:08:46.852306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 162/296] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:46 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:47.082428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:47.083947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:47.094371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:47.094988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:47.098144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:47.099011 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:47.201367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-54b0964e-4bd1-47f4-aa9f-4306a98724fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.126452 Jan 05 18:08:47.202715 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 135/297] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:47 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:47.713734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: .version_select at 0x7f73452c65e0>, body: {"keypair": {"name": "tempest-keypair-1549106129"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:47.762131 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:08:47.767338 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:08:47.866968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:47.867974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:47.874735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:47.875192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:47.875967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:47.876465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:48.009071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:08:48.016714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:08:48.048363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:48.059616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-873601e1-9407-44cd-90f2-16c5e9b61849 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.194324 Jan 05 18:08:48.059616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 136/298] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:47 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:48.077562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1ccda2d1-a3b0-404a-925e-c7e1fa63d9c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.483122 Jan 05 18:08:48.078613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 163/299] 10.222.0.26 () {62 vars in 1198 bytes} [Wed Jan 5 18:08:47 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 487 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 05 18:08:48.214357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:48.216376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:48.223362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:48.224310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:48.225249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:48.225841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:48.355895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5a8b96f2-9e23-4c77-840f-fbfce8d7e784 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.144740 Jan 05 18:08:48.360011 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 137/300] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:48 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:49.075302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:49.076657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:49.086087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:49.087009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:49.087996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:49.088669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:49.228471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:49.242732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a840eec4-3434-42f1-a897-6c950aa3cc6e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.171033 Jan 05 18:08:49.243435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 164/301] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:49 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:49.368569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:49.369577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:49.376232 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:49.383070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:49.383070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:49.383070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:49.474541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d91ccaad-01af-4672-9747-d9a5807ae431 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.109458 Jan 05 18:08:49.475271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 138/302] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:49 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:50.260172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:50.260777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:50.274421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:50.275280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:50.276847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:50.280701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:50.490054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:50.491755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:50.512058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:50.516297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:50.518486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:50.519957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:50.648183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-33a2ed1e-7d31-4d97-bba6-4f96b4545235 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.165079 Jan 05 18:08:50.649748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 139/303] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:50 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:50.959312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:50.970061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-714d65b9-4ca6-4619-b66c-10d35b5dd139 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.713897 Jan 05 18:08:50.971720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 165/304] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:50 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:51.517162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1162802777", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae9edd83-a753-43bb-9794-9ca1d1f00bcd"}], "security_groups": [{"name": "tempest-securitygroup--518371008"}], "key_name": "tempest-keypair-1549106129", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:51.664628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:51.665618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:51.674560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] validate_networks() for [('ae9edd83-a753-43bb-9794-9ca1d1f00bcd', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:08:51.679138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:51.679811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:51.680956 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:51.682259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:52.006874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-229ce138-ea00-4849-8b35-cbe04c9797ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.348976 Jan 05 18:08:52.006874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 166/305] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:51 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:52.013075 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:52.014301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:52.024584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:52.025322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:52.026160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:52.026652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:52.233585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:08:52.234131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:08:52.241557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:08:52.241557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:08:52.241557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:08:52.249352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:52.249812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:52.250681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:52.251123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:52.277756 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:08:52.283338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:08:52.289533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:52.298057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-81dbe1e6-b70e-49da-a007-71830548e754 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.289334 Jan 05 18:08:52.302530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:08:52.302647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 167/306] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:52 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:52.302742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:08:52.484947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bb5d6271-e367-42a5-8704-611d79f40229 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.972238 Jan 05 18:08:52.485591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 140/307] 10.222.0.26 () {62 vars in 1187 bytes} [Wed Jan 5 18:08:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 05 18:08:52.498472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:52.498993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:52.559054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:52.567927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:52.569666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:52.570915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2b126fae-50c7-4a60-89d7-d59caa14d1e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1282 microversion: 2.20 time: 0.078669 Jan 05 18:08:52.575833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 168/308] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:52 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:53.019854 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:53.020815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:53.027547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.027989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.028753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.029188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.127101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5addbdb1-8e63-4498-bebf-55946802287c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.111871 Jan 05 18:08:53.128012 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 141/309] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:53 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:53.317619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:53.318272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:53.331527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.331961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.332754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.333360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.466686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:53.475738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d56f352d-9c93-4551-ab96-bf421352b137 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.163947 Jan 05 18:08:53.476471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 169/310] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:53 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:53.593280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:53.593973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:53.601324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.601785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.602595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:53.603009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:53.678050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:53.692843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:53.695094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:53.696428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-36a14d24-9b41-4870-91cb-110f51668bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1286 microversion: 2.20 time: 0.107462 Jan 05 18:08:53.697301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 142/311] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:53 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:54.138571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:54.139480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:54.146449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.147030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.147929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.148618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.366884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-01ed054e-fa42-4d22-86a0-981cea4aae83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.231695 Jan 05 18:08:54.368202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 170/312] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:54 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:08:54.492911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:54.493676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:54.499171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.499621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.500386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.500823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.654667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:54.662872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-935408b8-df4b-489a-8658-47de9f5c4a1d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.173563 Jan 05 18:08:54.663494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 143/313] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:54 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:54.715863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:54.716545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:54.723475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.724177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.724938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:54.725367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:54.788495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:54.797807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:54.799958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:54.801336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-552a4a35-2212-47bc-a43f-7a0b6e6764fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.089584 Jan 05 18:08:54.801881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 171/314] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:54 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:55.379723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:08:55.383244 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:55.386500 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.387085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.387795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.388338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.680225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:55.680821 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:55.692697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.693146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.693920 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.695503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.824378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:55.840682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b198285c-c18b-4509-b483-deef3be9ce6b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.164127 Jan 05 18:08:55.841183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 172/315] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:55 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:55.845652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:55.846661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:55.852979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.853484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.854195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:55.854625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:55.920016 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:55.934246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:55.937164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:55.939249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d52fb763-cd95-4bc8-a308-3d881c2e5023 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.096612 Jan 05 18:08:55.941381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 173/316] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:55 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:56.862380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:56.863618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:56.874445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:56.875295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:56.876779 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:56.878056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:57.021804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:57.029248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7412ccdf-3a8d-4062-9f17-c76d9c882ede tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.174012 Jan 05 18:08:57.029813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 174/317] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:56 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:08:57.038873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:57.039554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:57.045535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:57.045988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:57.047300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:57.047300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:57.114161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:57.122659 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:57.124086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:57.125216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-91e292f2-bcc1-49ae-a02f-568d0096fb1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.094323 Jan 05 18:08:57.125883 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 175/318] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:57 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:58.046502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:58.047097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:58.054152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:58.055288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:58.055400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:58.055796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:58.181380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:58.189185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-197bfba5-c824-49fd-b5b1-4c55426bd79e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.146256 Jan 05 18:08:58.190719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 176/319] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:58 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:58.196056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:58.196667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:58.203536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:58.203989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:58.204803 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:58.205424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:58.273212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:58.282661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:58.284728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:58.286853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c5c14c38-fd5f-431e-9d68-fa1acebdc5a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.095305 Jan 05 18:08:58.288308 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 177/320] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:58 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:08:59.206715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:59.207399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:59.213166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:59.213702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:59.214583 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:59.215089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:59.335785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:59.344163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ad2b41a1-79e7-4097-b567-38695b9543e6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.141798 Jan 05 18:08:59.344732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 178/321] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:08:59 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:08:59.350007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:08:59.350627 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:08:59.356454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:59.356850 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:59.357627 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:08:59.358087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:08:59.420006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:59.428245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:59.429829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:08:59.430947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-26123770-5ff7-4e56-a0f8-bed9ae54dcbb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.085311 Jan 05 18:08:59.431496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 179/322] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:08:59 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:00.156030 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cae996f8-786e-44f0-b328-b1a22912e911 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.780942 Jan 05 18:09:00.156611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 144/323] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:08:55 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:00.362033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:00.362634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:00.368572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:00.369022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:00.369789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:00.370259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:00.449892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:00.450110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:00.457293 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:00.457747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:00.458676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:00.459068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:00.495728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:00.503257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4d201cca-f2da-4038-a3f5-a1fd6a30e58f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.144778 Jan 05 18:09:00.504027 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 180/324] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:00 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:00.526323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:00.535102 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:00.536621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:00.537801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d552b03-ea80-4221-9083-9a53d7536b1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1334 microversion: 2.20 time: 0.092643 Jan 05 18:09:00.538394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 145/325] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:00 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:01.167693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:01.168623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:01.175341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.175875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.176851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.177443 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.321828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f58d8ac2-6ead-4824-b25b-36c52beb7812 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.157570 Jan 05 18:09:01.322704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 181/326] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:01 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:01.521295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:01.521895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:01.529046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.529502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.530386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.530829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.556855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:01.557626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:01.564654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.569324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.570406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:01.570943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:01.678545 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:01.686295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d11e087-c787-4a70-baeb-ae7445666389 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.169835 Jan 05 18:09:01.689718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 146/327] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:01 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:01.787181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:01.796955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:01.799304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:01.801292 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8270fd3b-3e4a-4e02-9746-eb936f79cada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.249097 Jan 05 18:09:01.801879 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 182/328] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:01 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:02.334199 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:02.335120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:02.341054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.342120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.343899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.344544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.484577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-8a251bb3-3128-4d7a-8006-4c6f287f1ae2 req-4d669975-8fae-4e5d-adb6-f3431819dbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:02.486106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:09:02.486106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:09:02.494127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8a251bb3-3128-4d7a-8006-4c6f287f1ae2 req-4d669975-8fae-4e5d-adb6-f3431819dbce service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.494760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8a251bb3-3128-4d7a-8006-4c6f287f1ae2 req-4d669975-8fae-4e5d-adb6-f3431819dbce service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.507209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-8a251bb3-3128-4d7a-8006-4c6f287f1ae2 req-4d669975-8fae-4e5d-adb6-f3431819dbce service nova] Creating event network-changed:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:09:02.512459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-8a251bb3-3128-4d7a-8006-4c6f287f1ae2 req-4d669975-8fae-4e5d-adb6-f3431819dbce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031620 Jan 05 18:09:02.515272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 183/329] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:09:02.520509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c7360d46-f0a6-4fd2-9c0d-30f26ef88427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.190051 Jan 05 18:09:02.524637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 147/330] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:02 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:02.706464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:02.707144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:02.713163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.713608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.714429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.714858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.820163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:02.820992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:02.827830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.828534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.835630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:02.835630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:02.899974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:02.907597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ee3f387c-884a-4b11-9d8c-0616c3b2e628 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.205906 Jan 05 18:09:02.908172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 184/331] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:02 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:02.954170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:02.963042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:02.964530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:02.965631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eef69d2e-e8e8-45cf-ae1a-e249a3d31a31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.149594 Jan 05 18:09:02.966222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 148/332] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:02 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:03.532009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:03.532935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:03.539324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:03.539778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:03.540548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:03.540985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:03.924070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:03.924665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:03.930814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:03.931253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:03.932009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:03.932436 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:04.053341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:04.074820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c3b8f616-98a1-4cfe-b354-8a5ebba7b300 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.140116 Jan 05 18:09:04.074820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 149/333] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:03 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:04.074820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:04.074820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:04.074820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:04.075208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:04.075208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:04.075208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:04.195554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:04.203360 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:04.204895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:04.206136 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2b72a435-f035-4881-823d-c5865ae579b4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.144007 Jan 05 18:09:04.206694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 150/334] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:04 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:05.081486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:05.082116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:05.088112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:05.088560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:05.089327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:05.089755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:05.350919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:05.357997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-595556d0-ca49-41a4-bfa3-1f4ea3035c00 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.280456 Jan 05 18:09:05.358570 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 151/335] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:05 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:05.363269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:05.363860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:05.369064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:05.369510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:05.370294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:05.370732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:05.489254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:05.496890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:05.498397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:05.499484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a56ae8a3-a305-4c2f-89d3-bb2111c56390 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.140010 Jan 05 18:09:05.500034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 152/336] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:05 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:06.374892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:06.375552 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:06.381717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:06.382196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:06.382956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:06.383383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:06.500532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:06.508521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b197f7e1-4a2b-49a7-a018-f14844734d2d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.137181 Jan 05 18:09:06.509089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 153/337] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:06 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:06.515860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:06.516455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:06.522795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:06.523237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:06.524031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:06.524465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:06.643502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:06.651485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:06.652997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:06.654094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f0355169-a126-4e9a-96bd-9e555104d2f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.141568 Jan 05 18:09:06.654644 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 154/338] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:06 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:07.525899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:07.526557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:07.532429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:07.532878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:07.534203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:07.534647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:07.654789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:07.662464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-872f396e-9784-4d0c-abe8-66a352961663 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.140204 Jan 05 18:09:07.663021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 155/339] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:07 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:07.672959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:07.673567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:07.680042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:07.680490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:07.681262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:07.681698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:07.797953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:07.806210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:07.807693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:07.808772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4c66d242-66b4-4b34-8611-2edbd0d413cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.139387 Jan 05 18:09:07.809324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 156/340] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:07 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:07.925045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ed482edc-54f6-49c4-ab99-d13797a669ca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 4.396419 Jan 05 18:09:07.928614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 185/341] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:03 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 4398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:08.679123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:08.679720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:08.685672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.686157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.686924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.687358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.811172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:08.818899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-96822b6c-2453-4244-84d8-0c20a76c3cc5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.143407 Jan 05 18:09:08.819465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 157/342] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:08 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:08.826560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:08.827251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:08.834246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.834698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.835467 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.835904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.935961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:08.936966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:08.943974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.944494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.945271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:08.945702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:08.994350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:09.006696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:09.008235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:09.009336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b97f842e-1e3d-4001-8d23-76995b16a13c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.186829 Jan 05 18:09:09.010058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 186/343] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:08 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:09.729794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-48b9531c-97f7-4fe6-9d36-78fb0a288b11 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28156 microversion: 2.1 time: 0.797286 Jan 05 18:09:09.730472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 158/344] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:08 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28156 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:09.835343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:09.835954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:09.842257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:09.842809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:09.843481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:09.844046 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:09.979681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:09.987059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-10c66e7a-41bd-4714-ad5e-5127773ee049 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.155385 Jan 05 18:09:09.987551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 187/345] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:09 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:10.027777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:10.028565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:10.035445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:10.036233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:10.037109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:10.037986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:10.182325 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:10.190709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:10.192059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:10.193110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-68acf440-3977-49b0-b679-b3bf2f55740f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.169508 Jan 05 18:09:10.193659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 159/346] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:10 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:10.741929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:10.742880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:10.748835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:10.749288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:10.750090 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:10.750536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:10.929029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ea5b382f-6a61-4756-b70d-af5ab3de8964 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28171 microversion: 2.1 time: 0.190596 Jan 05 18:09:10.929728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 188/347] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:10 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28171 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:11.002974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:11.003619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:11.009391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.009843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:11.010653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.011137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:11.136114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:11.144439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a25bde92-424c-40dc-8007-a10534868304 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.145306 Jan 05 18:09:11.145006 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 160/348] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:10 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:11.211694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:11.212417 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:11.219101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.219553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:11.220337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.220830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:11.356962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:11.379767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:11.382678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:11.383831 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e1d4495-bf98-4b52-ae7b-7f48b5e391e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.176132 Jan 05 18:09:11.384393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 189/349] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:11 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:11.952101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:11.953018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:11.958918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.959320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:11.960165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:11.960609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.076143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-35ebe82f-d3cd-4011-8533-ba4c539cbe23 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28447 microversion: 2.1 time: 0.127572 Jan 05 18:09:12.077483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 161/350] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:11 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:12.161169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:12.162435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:12.168219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.168661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.169478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.169914 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.293073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:12.301603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b06111fd-cdc6-47b0-bd0e-27a68cb66cf8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1502 microversion: 2.1 time: 0.144857 Jan 05 18:09:12.302195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 190/351] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:12 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:12.318031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca434372-f2a7-43c6-8547-b2ade4366914"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:12.319250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:12.325573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.326130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.326975 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.327483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.351348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 while it is in vm_state rescued Jan 05 18:09:12.354201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Returning 409 to user: Cannot 'attach_volume' instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 while it is in vm_state rescued {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:09:12.354201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6ac6ec18-c0d1-4a26-bef8-ec7306167194 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039039 Jan 05 18:09:12.354201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 162/352] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:09:12 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 05 18:09:12.362336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:12.362950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:12.368719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.369169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.369985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.370444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.401836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:12.402541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:12.408938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.411638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.411638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.411638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.572621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cd62b2d0-f7bf-419b-80e4-9430e7d2cc9f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action" status: 202 len: 0 microversion: 2.1 time: 0.214135 Jan 05 18:09:12.576709 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 191/353] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:12 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:09:12.582097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:12.584897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:12.585770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:12.593186 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.593901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.594934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:12.595599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:12.603814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:12.611771 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:12.613248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-20737497-aba5-43bc-87bf-275e79c5c58c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.215131 Jan 05 18:09:12.614642 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 163/354] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:12 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:12.842894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:12.851877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1c654b7b-6ec0-41fe-ae75-843001924ccb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1510 microversion: 2.1 time: 0.272937 Jan 05 18:09:12.852521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 192/355] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:12 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:13.088019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:13.089609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:13.095575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.098521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:13.098521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.098691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:13.219232 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-148069ad-055e-4952-8892-9d94a6d40026 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28447 microversion: 2.1 time: 0.134384 Jan 05 18:09:13.223171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 164/356] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:13 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28447 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:13.632038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:13.632625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:13.638391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.643386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:13.643386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.643386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:13.794168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:13.809540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:13.811345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:13.812461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6c4622d6-e60f-4e6c-a77b-9c9515e02576 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.184364 Jan 05 18:09:13.813227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 193/357] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:13 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:13.870406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:13.871110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:13.878193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.878870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:13.879669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:13.880114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:14.011571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:14.015562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a37b0e1b-9116-4820-a5fc-1309f8f17027 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1510 microversion: 2.1 time: 0.149600 Jan 05 18:09:14.016125 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 165/358] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:13 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:14.231671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:14.232577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:14.239680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:14.240063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:14.241598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:14.242051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:14.447091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7d279c28-1873-4560-a60b-bd9ddc48b919 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.218889 Jan 05 18:09:14.447727 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 194/359] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:14 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:14.829431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:14.830594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:14.836592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:14.837049 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:14.837816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:14.838276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:14.961745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:14.969747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:14.971358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:14.972475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d3eb1a26-f0d9-462b-be66-96e98504ced7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.146758 Jan 05 18:09:14.973024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 166/360] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:14 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:15.032985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:15.033853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:15.040278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.040733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:15.041502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.041932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:15.169431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:15.176807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c9ea335d-6bb9-4568-9858-44944fedfd07 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1510 microversion: 2.1 time: 0.147887 Jan 05 18:09:15.177380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 195/361] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:15 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:15.461376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:15.461376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:15.467230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.467706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:15.468692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.469143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:15.574496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-302f9cad-38a7-44f8-8471-d61288076a35 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.119249 Jan 05 18:09:15.575134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 167/362] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:15 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:15.990280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:15.990973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:15.996639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.997089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:15.997860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:15.998323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.126833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:16.134913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:16.136666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:16.137528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-119b0e27-7cc0-4a0f-86b2-aa609b9f66a6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.151373 Jan 05 18:09:16.138117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 196/363] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:15 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:16.194264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:16.194987 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:16.201269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:16.202264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.202543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:16.202989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.387062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:16.395587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f551fc3f-ac10-47a2-8a7a-f329c7981987 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1510 microversion: 2.1 time: 0.205207 Jan 05 18:09:16.396171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 168/364] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:16 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:16.591843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:16.592681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:16.605958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:16.606887 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.608399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:16.609056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.689935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-4ad7e722-8a77-4786-af42-a5eb0cb3099e req-375fa04c-778d-4186-84e1-b91b29292b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "name": "network-vif-plugged", "status": "completed", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:16.692556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:09:16.692556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:09:16.699934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-4ad7e722-8a77-4786-af42-a5eb0cb3099e req-375fa04c-778d-4186-84e1-b91b29292b77 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:16.705304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-4ad7e722-8a77-4786-af42-a5eb0cb3099e req-375fa04c-778d-4186-84e1-b91b29292b77 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:16.711891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-4ad7e722-8a77-4786-af42-a5eb0cb3099e req-375fa04c-778d-4186-84e1-b91b29292b77 service nova] Creating event network-vif-plugged:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:09:16.716898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-4ad7e722-8a77-4786-af42-a5eb0cb3099e req-375fa04c-778d-4186-84e1-b91b29292b77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Jan 05 18:09:16.717477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 169/365] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:09:16.799278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-53f67b9a-6148-4142-a9c6-4116b087194c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.212228 Jan 05 18:09:16.800912 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 197/366] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:16 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:17.156435 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:17.157701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:17.164633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.165082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:17.165880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.166496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:17.292614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:17.300908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:17.302704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:17.303798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0fa2d5ab-45f2-47b0-997e-1159ee4ca98f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.151842 Jan 05 18:09:17.304345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 170/367] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:17 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:17.413658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:17.414303 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:17.420812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.421265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:17.422121 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.422567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:17.554331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:17.561505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9214fd28-d060-47f2-b38a-f54cd1b99520 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1516 microversion: 2.1 time: 0.152471 Jan 05 18:09:17.562419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 198/368] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:17 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:17.811062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:17.811976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:17.818261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.818715 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:17.819482 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:17.819920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:18.320874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:18.321472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:18.327205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:18.327647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:18.328408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:18.328918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:18.454959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:18.464247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:18.465848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:18.467117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-58d5dbd2-a56a-4ada-9d22-d952f0c2298f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.149947 Jan 05 18:09:18.467769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 199/369] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:18 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:19.484533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:19.488705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:19.491204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:19.491655 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:19.492427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:19.492866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:19.616333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:19.624243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:19.625778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:19.626922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1c86ca2e-a4e1-4522-90fc-3ad0fe46e045 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.146102 Jan 05 18:09:19.627489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 200/370] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:19 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:20.645557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:20.646183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:20.652268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:20.652708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:20.653460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:20.653886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:20.772878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:20.780496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:20.781991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:20.783270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bf5a4ce2-947f-4ad6-b510-0c8ce223ea41 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.142112 Jan 05 18:09:20.783818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 201/371] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:20 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:21.800284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:21.800897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:21.807380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:21.807833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:21.808613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:21.809049 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:21.926977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:21.935739 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:21.937254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:21.938366 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df0c332e-3d4c-49e1-8303-4dd0f9b97af7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.141673 Jan 05 18:09:21.938922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 202/372] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:21 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:09:22.762173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0915e691-4f89-4718-ad27-3a7e6ac590d4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 4.954535 Jan 05 18:09:22.763483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 171/373] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:17 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 4956 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:22.955679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:22.956280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:22.962231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:22.962686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:22.963459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:22.963896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:23.083173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:23.090923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:23.092427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:23.093644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b8bb8bc2-92de-430d-8d80-fc25a413fac5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.141656 Jan 05 18:09:23.094246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 203/374] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:22 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:23.774625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:23.775622 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:23.781974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:23.782461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:23.783265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:23.783701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:23.874659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bbbdb98f-40ab-4363-a0f7-3e6b16c13df9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.104485 Jan 05 18:09:23.878106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 172/375] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:23 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:24.111729 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:24.112329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:24.118005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:24.118494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:24.119251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:24.119675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:24.237551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:24.245917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:24.247535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:24.248629 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-12c63cbb-c0d0-4c94-bff7-0817e5b44d7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1407 microversion: 2.20 time: 0.140623 Jan 05 18:09:24.249174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 204/376] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:24 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:24.887051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:24.888182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:24.894759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:24.895209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:24.896039 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:24.896505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:24.997873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7336dc62-8222-483e-af57-92ead80b4ddd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.114693 Jan 05 18:09:24.998546 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 173/377] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:24 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:25.267029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:25.267622 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:25.274331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.274772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.275526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.275955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.393561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:25.402084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:25.403561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:25.404694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5612a9d4-4131-4118-bd51-bd29dc5d2e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1598 microversion: 2.20 time: 0.141554 Jan 05 18:09:25.405255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 205/378] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:09:25 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1598 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:25.422387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:25.422967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:25.429401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.429849 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.430650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.431080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.510304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-24a1956a-197a-40d5-a30d-19bef8344fa3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092137 Jan 05 18:09:25.510920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 174/379] 10.222.0.26 () {60 vars in 1315 bytes} [Wed Jan 5 18:09:25 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:25.537556 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:25.538495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:25.544387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.544970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.546212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.546723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.670350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:25.677591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4198970e-3023-4657-a7d2-7ac0d1bf79e7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1516 microversion: 2.1 time: 0.143642 Jan 05 18:09:25.678182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 206/380] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:25 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1516 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:25.693789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d605615a-e54b-4674-87af-188614b54def"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:25.694867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:25.700667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.701116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:25.701880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:25.702355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.010322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:26.011745 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:26.018648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:26.018974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.020481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:26.020962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.106842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6c7f0ac1-27ea-4d03-88c8-fa2730b8f81b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.101530 Jan 05 18:09:26.107629 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 207/381] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:26 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:26.486047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-94dbd677-49e8-4733-bcb9-67e3d347b21d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796272 Jan 05 18:09:26.486664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 175/382] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:09:25 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:09:26.710724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:26.713260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:26.719085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-0eefa954-a286-457e-abca-71acb568dfce req-932a6d52-88ef-4787-9597-a4a650244844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:26.720614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:09:26.720614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:09:26.729938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:26.735839 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-0eefa954-a286-457e-abca-71acb568dfce req-932a6d52-88ef-4787-9597-a4a650244844 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:26.736307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-0eefa954-a286-457e-abca-71acb568dfce req-932a6d52-88ef-4787-9597-a4a650244844 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.740667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.741336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:26.741780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:26.752458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-0eefa954-a286-457e-abca-71acb568dfce req-932a6d52-88ef-4787-9597-a4a650244844 service nova] Creating event network-changed:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:09:26.766312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-0eefa954-a286-457e-abca-71acb568dfce req-932a6d52-88ef-4787-9597-a4a650244844 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051194 Jan 05 18:09:26.767497 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 176/383] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:09:26.881322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6a4081b1-1b66-4e8e-97b6-25f201150ca4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.175043 Jan 05 18:09:26.884780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 208/384] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:26 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:27.119839 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:27.121258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:27.138685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:27.141775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:27.141775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:27.141775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:27.239362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-02418c54-1170-481a-b9dd-6550ba3e3fa4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.122691 Jan 05 18:09:27.244258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 177/385] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:27 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:27.893203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:27.895400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:27.902499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:27.902963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:27.903753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:27.904195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:27.996611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9512aa6d-c3ca-4d7d-af1e-641489cd4dc2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.107619 Jan 05 18:09:27.997276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 209/386] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:27 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:28.252397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:28.253457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:28.264564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:28.265003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:28.265773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:28.266244 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:28.356149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-edac1a4d-bad4-4e66-9217-28fdedec33b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.107608 Jan 05 18:09:28.356799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 178/387] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:28 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:29.007882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:29.008882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:29.015273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:29.015721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:29.016500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:29.016938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:29.143737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-15bccea1-8454-4161-8ad1-0504cb07f603 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.139686 Jan 05 18:09:29.144407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 210/388] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:29 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:29.375654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:29.376650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:29.383509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:29.383956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:29.384728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:29.385167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:29.481280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ccca1b23-9e95-4464-a0e6-b33b9903218e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.109999 Jan 05 18:09:29.485112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 179/389] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:29 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:30.157035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:30.158037 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:30.165025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:30.165453 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:30.168902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:30.168902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:30.253816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9d6895e0-4ecf-42f7-abf8-9ab955cbe32b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.100582 Jan 05 18:09:30.254574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 211/390] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:30 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:30.493022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:30.494338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:30.502357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:30.502804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:30.503578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:30.504045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:30.624065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3bcd007b-6f18-44f1-9a87-4eb2af6c98b4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.134777 Jan 05 18:09:30.627929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 180/391] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:30 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:31.271460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:31.272465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:31.278997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.279531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.280322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.280760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.297010 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bae94927-22fa-41d6-b5fc-8b6bdc2cfbd8", "device": "/dev/sdb"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:31.298833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:31.306407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.306857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.307686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.308085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.377038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b50e00e2-47be-4491-8e0e-15c8d942c298 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.109490 Jan 05 18:09:31.377753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 212/392] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:31 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:31.635386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:31.636382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:31.642907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.643356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.644119 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:31.644683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:31.744939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-05a6f319-209d-452d-a11c-264d8b77774e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.113384 Jan 05 18:09:31.745587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 213/393] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:31 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:32.055842 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-637a2e7b-adb6-402e-b91a-d6c0afab4590 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "POST /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762851 Jan 05 18:09:32.056471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 181/394] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:09:31 2022] POST /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:09:32.389063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:32.390100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:32.397183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:32.397637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:32.398575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:32.399015 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:32.491209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4fb3b654-4fff-4757-96c8-a713da74b5ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.106073 Jan 05 18:09:32.494562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 214/395] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:32 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:32.758999 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:32.760051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:32.766899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:32.767352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:32.768126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:32.768567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:32.862257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8189ad4c-ef4e-4844-9ffa-bb57d86c5d8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.108868 Jan 05 18:09:32.863417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 182/396] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:32 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:33.502501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:33.503515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:33.510088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:33.510537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:33.511310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:33.511746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:33.856003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-21660496-3248-4326-804b-550bcee762b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.357369 Jan 05 18:09:33.856628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 215/397] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:33 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:33.875142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:33.876129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:33.883257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:33.883734 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:33.884525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:33.884965 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:34.000463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6ac4a592-7a35-49da-873d-b258040d117d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.129121 Jan 05 18:09:34.001420 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 183/398] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:33 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:34.868182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:34.869183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:34.876310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:34.876759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:34.877544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:34.877978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.004642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-613ba00d-e8d9-4d9f-a484-dbecfe6cf41f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.140815 Jan 05 18:09:35.006941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 216/399] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:34 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:35.014110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:35.015190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:35.022735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.024014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.024014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.024438 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.132278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-831aef8f-8d0f-44ad-b52e-40e393949c84 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.122693 Jan 05 18:09:35.135307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 184/400] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:35 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:35.241142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:35.242736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:35.249682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.250176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.251148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.251580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.277068 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'flavor' on Instance uuid 4ddb291a-0f29-4cc4-8030-63b5c9bad269 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:09:35.799445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-031d7619-02b1-47a9-854c-a2a4601e6249 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action" status: 200 len: 32 microversion: 2.1 time: 0.562878 Jan 05 18:09:35.801411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 217/401] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:35 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action => generated 32 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:09:35.809841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:35.810898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:35.821699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.822452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.822954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:35.823382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:35.954231 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:35.963050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-687bacdd-1de9-4f95-9899-72ace00f25fe tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.157280 Jan 05 18:09:35.963620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 185/402] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:35 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:36.017137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:36.018206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:36.025516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:36.025965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:36.027079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:36.027520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:36.128434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a81f80b9-8476-4408-9b0a-8d40f9c531c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.115083 Jan 05 18:09:36.129873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 218/403] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:36 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:36.149955 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:36.151321 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:36.157433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:36.157963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:36.158962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:36.159352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:36.256926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-33919bfc-bdae-42a2-949c-11509bd43183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.110696 Jan 05 18:09:36.257643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 186/404] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:36 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:36.982910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:36.984336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:37.000873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.001358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.002384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.003014 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.140636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:37.141957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:37.149193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.149751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.150628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.151212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.243781 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:37.251860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-70da8144-5cd1-4d88-b7af-4bb776db6bc7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.115072 Jan 05 18:09:37.252986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 187/405] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:37 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:37.255647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ca64f221-62ad-449c-af2a-1cf11bfa9e06 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.278261 Jan 05 18:09:37.256472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 219/406] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:36 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:37.271029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:37.272437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:37.291359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.292579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.293002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:37.293439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:37.399793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ed34dd36-7a67-4ae9-a1c3-baf0063e332a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.134246 Jan 05 18:09:37.400851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 188/407] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:37 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:38.263606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:38.279887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:38.280304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:38.285779 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:38.288158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.289276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.290443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.291083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.295833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.296501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.297665 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.298279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.396571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a527554b-a42a-467c-8834-caa9da58f7dc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 14 microversion: 2.20 time: 0.138149 Jan 05 18:09:38.397494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 220/408] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:38 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:38.413573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:38.415760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:38.426611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.427375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.428436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:38.429077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:38.532242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:38.544266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-772470e6-d409-4647-8182-118a291323ee tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.134626 Jan 05 18:09:38.545861 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 221/409] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:38 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:38.548079 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d836ce08-eb3c-48d6-925e-07b57a12765e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.277601 Jan 05 18:09:38.562362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 189/410] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:38 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:39.408422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:39.409350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:39.416691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.417148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.417927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.418404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.532101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-303587c5-2f4c-4e3d-abe1-87f23aa611bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 2680 microversion: 2.20 time: 0.127658 Jan 05 18:09:39.533313 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 222/411] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:39 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 2680 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:39.567091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:39.568166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:39.568871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:39.574142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:39.576805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.577538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.578705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.579450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.585334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.586254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.587728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:39.588814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:39.732729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ee0356d9-258b-45ed-b93e-6446ee4ba27f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.178800 Jan 05 18:09:39.739087 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 190/412] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:39 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:39.812649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:39.822368 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-65e34cc2-d966-443c-a9db-e2420375512d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.259121 Jan 05 18:09:39.823252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 223/413] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:39 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:40.546545 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:40.548122 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:40.558255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.559105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.560091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.560860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.672559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d160034b-e1c5-41bc-96b4-610345ff2f43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 9710 microversion: 2.20 time: 0.131816 Jan 05 18:09:40.674841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 191/414] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:40 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 9710 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:09:40.755047 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:40.757207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:40.764584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.765331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.766875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.767514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.850007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:40.851041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:40.874230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.875130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.877207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:40.878968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:40.916255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-af78abf0-07f0-4c6e-b820-b1ac7ca16427 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.172772 Jan 05 18:09:40.920385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 224/415] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:40 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:41.158955 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:41.167363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ba9eedbc-ebfb-44f6-bf46-7d3406291408 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.322264 Jan 05 18:09:41.176803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 192/416] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:40 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:41.686496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:41.688175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:41.695110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:41.695553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:41.696474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:41.696909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:41.927718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:41.928723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:41.934928 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:41.935377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:41.941730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:41.942377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:42.046123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-46646819-0bb9-40a9-b94e-0e06861feea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 15025 microversion: 2.20 time: 0.363364 Jan 05 18:09:42.050475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 225/417] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:41 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 15025 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:09:42.184901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:42.185330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:42.195177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:42.195177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:42.195458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:42.196055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:42.262543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7c2a03c7-7198-413b-9bac-df405a4585b9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.338184 Jan 05 18:09:42.266081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 193/418] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:41 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:09:42.396678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:42.409215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9efdc85b-8784-4d39-86b0-ad21e141cdb9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.228429 Jan 05 18:09:42.409804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 226/419] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:42 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:43.071729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:43.071729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:43.075524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.076089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.076879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.077316 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.186483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-35ccd6e1-9902-41d8-a042-f8d9d8ed7276 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 17861 microversion: 2.20 time: 0.132777 Jan 05 18:09:43.188286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 194/420] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:43 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 17861 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:09:43.275154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:43.276435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:43.284728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.289191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.289191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.289191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.417694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-95ddbdc7-1657-465d-9628-b4231ee3d1b8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.146928 Jan 05 18:09:43.418907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 227/421] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:43 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:43.428678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:43.432998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:43.438666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.439522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.440736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:43.442068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:43.682866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:43.691759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-930301ae-b243-45b9-a4ba-db2d619f1c31 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.267781 Jan 05 18:09:43.692341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 195/422] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:43 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:44.198616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:44.199635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:44.209614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.210353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.211323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.211922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.385795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-124e624d-2d68-47dd-9b17-4493d1278d54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 18083 microversion: 2.20 time: 0.190894 Jan 05 18:09:44.386587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 228/423] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:44 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 18083 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:09:44.431013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:44.433174 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:44.440463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.442578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.443569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.444622 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.561380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a07dff96-71a3-4c27-b731-29759833f865 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.136188 Jan 05 18:09:44.563668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 196/424] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:44 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:44.713616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:44.713616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:44.723463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.725507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.728709 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:44.730052 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:44.932803 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:44.942332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d1d5a158-7827-49d0-ab7e-973146745c0e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.236748 Jan 05 18:09:44.954179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 229/425] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:44 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:45.399709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:45.401907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:45.418591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.419453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:45.420718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.421363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:45.532372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9f0597ad-3c62-4155-a1ac-f22c7849bce0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 20997 microversion: 2.20 time: 0.137794 Jan 05 18:09:45.533034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 197/426] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:45 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 20997 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:09:45.575325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:45.577263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:45.586188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.586606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:45.587568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.588098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:45.712094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-21da43d2-d71a-4016-a3fc-4427d84efc76 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.140231 Jan 05 18:09:45.712753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 230/427] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:45 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:45.961003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:45.961792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:45.968892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.969431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:45.970523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:45.971036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:46.547316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:46.548377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:46.555135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:46.555908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:46.557490 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:46.557975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:46.561873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:46.574058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-55ae1c59-6c65-4430-9613-71209ea1db15 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.617875 Jan 05 18:09:46.589185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 198/428] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:45 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:46.695039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d6c413f2-f313-4701-bd51-db793389e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 22981 microversion: 2.20 time: 0.154455 Jan 05 18:09:46.696818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 231/429] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:46 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 22981 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:09:46.725021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:46.726415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:46.733171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:46.733851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:46.734832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:46.735426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:46.843950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-57bd04ba-53b1-44fb-bdb2-17a054d476e9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.122981 Jan 05 18:09:46.851853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 199/430] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:46 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:47.593183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:47.594277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:47.601762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.605195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:47.605195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.605195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:47.714933 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:47.716074 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:47.728288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.729036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:47.734392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.737591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:47.775683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:47.784043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2ed42b52-936c-4ca0-acb0-393d20e15e79 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.194971 Jan 05 18:09:47.784877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 232/431] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:47 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:47.856242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:47.857176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:47.863716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.864200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:47.865591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:47.866156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:52.463900 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c5b0edb5-bc31-4d61-bfbe-06f510b58ee0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 27706 microversion: 2.20 time: 4.755461 Jan 05 18:09:52.464479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 200/432] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:47 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 27706 bytes in 4762 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:09:52.499965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fa1ea3bd-8872-4560-8942-958da0518f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 4.647221 Jan 05 18:09:52.503835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 233/433] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:47 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 4649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:52.505405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:52.506147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:52.512379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:52.512836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:52.513606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:52.514067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:52.636819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:52.644556 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e260e148-408d-42bd-a795-7a1cfe758c7f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.142847 Jan 05 18:09:52.645124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 234/434] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:52 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:52.658789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Action: 'create', calling method: .version_select at 0x7f7344b77b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-591133659"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:52.676317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:09:52.680833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for user 81e462cf75ac4791a7a11a8a20754b59 and project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:09:52.692792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [a693e300-6535-4d9a-a4e5-bed6bc478bb7] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 05 18:09:53.476564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:53.477481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:53.483316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.483770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.484546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.484983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.578206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0408eeae-6d10-41b9-8785-5bd426646ab0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 27822 microversion: 2.20 time: 0.106139 Jan 05 18:09:53.578827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 235/435] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:53 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 27822 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:09:53.584261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:53.585232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:53.591449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.591897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.592661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.593098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.676847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1850c33e-54e7-4228-8b99-35f15a895d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.096439 Jan 05 18:09:53.677369 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 236/436] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:53 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:53.682219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:53.682903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:53.689325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.689769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.690562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:53.690989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:53.700652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [a693e300-6535-4d9a-a4e5-bed6bc478bb7] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 60398. Jan 05 18:09:53.812004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:53.820306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-302164c2-ed85-43e8-b7f3-f71811cb08b8 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.141834 Jan 05 18:09:53.820969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 237/437] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:53 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:54.034848 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:09:54.038718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for user 81e462cf75ac4791a7a11a8a20754b59 and project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:09:54.053284 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a3935d6a-ff3a-45cf-8d90-f0b8fbcf5985 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.587488 Jan 05 18:09:54.053840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 201/438] 10.222.0.26 () {60 vars in 1157 bytes} [Wed Jan 5 18:09:52 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:09:54.589651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:54.590815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:54.596540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.597071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.597846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.598800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.681348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0ebfbe4f-ce53-4064-a576-2a31f9d04398 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 27822 microversion: 2.20 time: 0.095401 Jan 05 18:09:54.683886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 238/439] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:54 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 27822 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:09:54.689788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:54.690873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:54.697592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.698058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.698840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.699271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.781687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-12c2a934-421f-4b50-9bb2-bbd2811cf412 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.095574 Jan 05 18:09:54.783059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 202/440] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:54 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:09:54.837502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:09:54.838154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:54.844791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.845271 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.846028 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:54.846483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:54.970080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:09:54.979197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fa215ba5-1eff-407e-81ed-4f591f1e2ea2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.145960 Jan 05 18:09:54.979858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 239/441] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:09:54 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:09:55.700731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:55.701883 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:55.709334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:55.709790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:55.710679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:55.711120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:55.793013 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:09:55.795540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:09:55.800672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:55.801316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:09:55.802945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:09:55.803388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:00.141408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3d9622ac-abfe-4cb6-999d-84af1c4a44ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 27822 microversion: 2.20 time: 4.445377 Jan 05 18:10:00.145855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 203/442] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:09:55 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 27822 bytes in 4447 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:00.147989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:00.148687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:00.155030 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:00.155519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:00.156304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:00.156753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:00.159187 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-331d296a-2586-4540-8b4c-bb85d2831081 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 4.369775 Jan 05 18:10:00.160288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 240/443] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:09:55 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 4371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:00.288830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:00.296593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7e8da365-c505-456d-ae68-53c941ff99b2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.153306 Jan 05 18:10:00.297150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 204/444] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:00 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:01.153736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:01.154777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:01.161752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.162347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.163061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.163504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.170573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:01.172751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:01.180931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.181381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.182623 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.182623 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.397843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-30175417-0bba-428c-9fd5-8e9c289ce9ad tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 27888 microversion: 2.20 time: 0.247906 Jan 05 18:10:01.405345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 241/445] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:01 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 27888 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:01.405345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:01.405345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:01.410329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.411404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.412168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:01.412663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:01.430307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1735b79e-60be-4d36-809f-f0b44669e488 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.263839 Jan 05 18:10:01.431151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 205/446] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:01 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:01.541344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:01.549081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e125badd-ea70-4845-95bf-423f372452b6 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.149480 Jan 05 18:10:01.549646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 242/447] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:01 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:02.410141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:02.411055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:02.417990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.418466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.419226 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.419658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.442148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:02.445309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:02.449750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.450305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.451150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.451676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.554359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-99461a48-3d1b-4ca6-bed7-4010d06e9cab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28000 microversion: 2.20 time: 0.148216 Jan 05 18:10:02.558092 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 206/448] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:02 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28000 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:02.567152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:02.567836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:02.569738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7a7fed40-8afc-48cd-b252-9b39d2aabc68 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.131123 Jan 05 18:10:02.570642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 243/449] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:02 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:02.574361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.574808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.575572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:02.575999 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:02.695148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:02.703558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2025e033-a9c6-4f1f-be2a-fcc693d2b579 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.140126 Jan 05 18:10:02.704123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 207/450] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:02 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:03.570248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:03.571243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:03.577481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:03.577925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:03.578734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:03.579169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:03.581437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:03.582549 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:03.591315 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:03.591764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:03.593084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:03.593930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:11.975983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-04b71d4e-cf80-4ad3-ad2c-067dde8dde15 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28067 microversion: 2.20 time: 8.410589 Jan 05 18:10:11.976630 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 244/451] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:03 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28067 bytes in 8412 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:11.981338 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:11.988714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:11.988714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:11.988969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:11.989516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:11.989959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:11.999852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-66544bcb-55e4-4de5-b0d0-bdbca0186eaf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 8.422297 Jan 05 18:10:12.003911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 208/452] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:03 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 8424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:12.113293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:12.121862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1e130289-78c3-4e39-9cc0-fa4b402f688d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.144079 Jan 05 18:10:12.122395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 245/453] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:11 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:12.998890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:12.999891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:13.007233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.007737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.008626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.009060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.012108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:13.013022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:13.019142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.019583 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.020344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.020774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.169145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-53927ebf-8bbe-4d77-924d-3d0ebf7e4c5a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28067 microversion: 2.20 time: 0.164694 Jan 05 18:10:13.169145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 209/454] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:12 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28067 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:13.169145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:13.169145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:13.172166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.172615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.173388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:13.173826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:13.201430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8f7e3fbb-4943-4044-bb24-65af4c29809c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.192703 Jan 05 18:10:13.205501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 246/455] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:13 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:13.299908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:13.306873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5855157f-dec0-473f-80ce-52b1c042b397 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.145556 Jan 05 18:10:13.307428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 210/456] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:13 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:14.172123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:14.173118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:14.179940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:14.180398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:14.181235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:14.181603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:14.213811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:14.215361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:14.221573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:14.222032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:14.222824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:14.223260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:15.532200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:10:15.532780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:10:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action (ip 10.222.0.26) !!! Jan 05 18:10:17.676332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3acdad1f-d408-4ef0-93c0-7e04fe55f33b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 3.466948 Jan 05 18:10:17.676976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 211/457] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:14 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 3468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:17.682489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:17.683197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:17.689610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:17.690089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:17.690870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:17.691314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:17.811759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:17.819475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9d8cd20f-11db-4074-bd59-3937a26d56ce tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.141407 Jan 05 18:10:17.820031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 212/458] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:17 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:18.689478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:18.690428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:18.697454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:18.697905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:18.698709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:18.699151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:19.358878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f052f9c4-d267-44bd-a72c-9838c915d443 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28067 microversion: 2.20 time: 5.190630 Jan 05 18:10:19.359521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 247/459] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:14 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28067 bytes in 5192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:19.365094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:19.370398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:19.376908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:19.378490 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:19.378960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:19.379734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:19.427157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1c693a7a-98f8-4f61-8718-99451e2ab89d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.741130 Jan 05 18:10:19.428757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 213/460] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:18 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:19.551114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:19.558929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9880490e-1409-47bc-87f0-e3816c4bb3cb tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.198085 Jan 05 18:10:19.559491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 248/461] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:19 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:20.371473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:20.372522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:20.378895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:20.379338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:20.380106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:20.380536 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:20.438653 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:20.439618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:20.446437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:20.447000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:20.447675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:20.448103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:21.155187 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1db11c4f-4d72-4375-a34f-3ace8b75fe01 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.719714 Jan 05 18:10:21.156592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 249/462] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:20 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:21.161488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:21.161755 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:21.168689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:21.169141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:21.169911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:21.170368 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:21.202048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a30c2ee5-2e71-41d5-ac72-4d80fa1a4d25 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.834311 Jan 05 18:10:21.202992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 214/463] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:20 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:21.295053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:21.302784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8469d8d9-c1a9-4f1c-b29d-4a2980959414 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.145727 Jan 05 18:10:21.303345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 250/464] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:21 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:22.168198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:22.169194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:22.175525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.175974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.176735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.177251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.213213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:22.214150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:22.226686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.226686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.226686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.226686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.443035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-46523f1e-2531-4e25-bf4f-6480d57594bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.279226 Jan 05 18:10:22.443739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 215/465] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:22 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:22.449197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:22.449879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:22.455689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.456197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.456967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:22.457400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:22.481365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5ace23ee-e1af-4585-aa21-66eaac65a1f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.271737 Jan 05 18:10:22.485964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 251/466] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:22 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:22.581236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:22.589964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bb037fab-5db2-450f-9247-a1ef1bdfe57e tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1568 microversion: 2.1 time: 0.144935 Jan 05 18:10:22.590563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 216/467] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:22 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:23.454616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:23.455775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:23.462978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.463424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.464202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.464636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.494445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:23.497099 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:23.503522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.504153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.504968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.505398 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.618070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-745c46eb-903f-4f64-8430-62059ecc1280 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.166572 Jan 05 18:10:23.618987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 252/468] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:23 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:23.624265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:23.624960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:23.631733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.639347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.639347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.639347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.646664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-23c0410b-0b27-458d-9a67-c55ca2691015 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.157330 Jan 05 18:10:23.648514 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 217/469] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:23 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:23.759074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:23.766575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5191f7b9-a2a6-4421-be55-2b6591e0b0cd tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1548 microversion: 2.1 time: 0.146385 Jan 05 18:10:23.767125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 253/470] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:23 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:23.783762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:23.784368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:23.791625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.792114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.792888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.793324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.920190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] HTTP exception thrown: Cannot 'detach_volume' instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 while it is in vm_state rescued Jan 05 18:10:23.920826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Returning 409 to user: Cannot 'detach_volume' instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 while it is in vm_state rescued {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:10:23.921666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e4f227b9-6472-44c6-9384-ed77d19d724a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments/d605615a-e54b-4674-87af-188614b54def" status: 409 len: 152 microversion: 2.1 time: 0.142088 Jan 05 18:10:23.922246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 218/471] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:10:23 2022] DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments/d605615a-e54b-4674-87af-188614b54def => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 05 18:10:23.930466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:23.930999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:23.936803 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.937477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:23.938258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:23.938705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.152996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b753f09b-381a-4f15-aea7-fb8943468988 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action" status: 202 len: 0 microversion: 2.1 time: 0.225887 Jan 05 18:10:24.153579 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 254/472] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:23 2022] POST /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:24.161416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:24.162171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:24.171458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.171458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.172061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.172494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.294531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:24.302378 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc72fe12-6009-4e88-80df-e2755b364b25 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1556 microversion: 2.1 time: 0.144463 Jan 05 18:10:24.302938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 219/473] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:24 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1556 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:24.629385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:24.630596 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:24.638318 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.638770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.639555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.639985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.658036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:24.659610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:24.665750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.666520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.667309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.667737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.750394 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0d411f0b-ab37-4453-bd10-3a7429eca73e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.124858 Jan 05 18:10:24.751171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 255/474] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:24 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:24.759666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:24.760246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:24.766674 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.767122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.767890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:24.768322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:24.774104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-39eaa27a-2b21-4447-a1d1-c8fad38d70b6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.119909 Jan 05 18:10:24.774745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 220/475] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:24 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:24.900189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lazy-loading 'services' on Instance uuid 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:10:25.131505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-aeb1ae4b-afa2-480d-a457-84e9c3892404 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f/os-volume_attachments/bae94927-22fa-41d6-b5fc-8b6bdc2cfbd8" status: 202 len: 0 microversion: 2.1 time: 0.378378 Jan 05 18:10:25.132386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 256/476] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:10:24 2022] DELETE /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f/os-volume_attachments/bae94927-22fa-41d6-b5fc-8b6bdc2cfbd8 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:25.321160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:25.321864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:25.328421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.329490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.329610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.330054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.459794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:25.468257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-30520ecf-5ba2-4dbe-aa39-6272827d04c7 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1556 microversion: 2.1 time: 0.152056 Jan 05 18:10:25.468821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 221/477] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:25 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:25.765064 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:25.766212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:25.772560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.773581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.774588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.775041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.785721 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:25.786678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:25.792885 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.793386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.794254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:25.794705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:25.945249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-82dbb98e-396f-48a4-8c30-036f42607fc0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.183792 Jan 05 18:10:25.946332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 257/478] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:25 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:25.959623 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2fd992ac-aceb-4b01-a344-914ea4a29893 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.177365 Jan 05 18:10:25.961767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 222/479] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:25 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:26.486684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:26.487378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:26.494826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.503155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:26.503155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.503155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:26.648565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:26.657425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-86cdbfde-9fec-4e1d-9fd0-f55ffd3f607a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1556 microversion: 2.1 time: 0.174701 Jan 05 18:10:26.658153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 258/480] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:26 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:26.957220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:26.958161 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:26.964992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.965432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:26.966223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.966655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:26.972220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:26.973229 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:26.980192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.980645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:26.981593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:26.982050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.066105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c3e3e38c-c76a-4cc8-8c98-bc014f5fa7bb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.112716 Jan 05 18:10:27.066807 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 223/481] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:26 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:27.088799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ce3c50fb-df19-4c5c-acf7-5006a6866ba0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.120200 Jan 05 18:10:27.089477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 259/482] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:26 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:27.313145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:27.316240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:27.321355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.321812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.322629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.323068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.348509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:10:27.583225 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8460cf6e-7d8f-4d62-b002-8192a7cbf9d7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 204 len: 0 microversion: 2.1 time: 0.273678 Jan 05 18:10:27.583737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 224/483] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:10:27 2022] DELETE /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:10:27.592673 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:27.593370 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:27.600117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.600569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.601333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.601769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.675924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:27.676621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:27.682943 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.683619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.684751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:27.685185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:27.762062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:27.767548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f1df559c-9771-4b4c-bd23-59caacb29e9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1514 microversion: 2.1 time: 0.179024 Jan 05 18:10:27.768621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 260/484] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:27 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:27.858459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:27.878923 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-44ca3f33-9b16-44a4-b77e-9ad2dac6134d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1556 microversion: 2.1 time: 0.207010 Jan 05 18:10:27.881118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 225/485] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:27 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:28.078159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:28.079738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:28.086406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.087036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.088054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.088737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.100997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:28.101929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:28.108182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.108637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.109597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.110097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.216536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cb5256a6-eab7-4b98-aa28-994db420b1e3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.141563 Jan 05 18:10:28.217822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 261/486] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:28 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:28.245007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4062a0d4-3666-42be-a8e6-14551f82ca8c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.147062 Jan 05 18:10:28.246070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 226/487] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:28 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:28.785012 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:28.786472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:28.796658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.797179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.797978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.798444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.901359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:28.902121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:28.911710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.911710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.911710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:28.911710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:28.925166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:28.933419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3bc7a5a8-e7cc-4e1d-b779-a6c293e58a8f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1514 microversion: 2.1 time: 0.152334 Jan 05 18:10:28.934117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 262/488] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:28 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:29.163543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:29.172612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9b10fc68-dcfc-4b49-a46b-37eb4c2bedd9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1556 microversion: 2.1 time: 0.275558 Jan 05 18:10:29.173197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 227/489] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:28 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1556 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:29.228177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:29.229186 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:29.235786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.236243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:29.237135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.237584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:29.256808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:29.258485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:29.267297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.267751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:29.268773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.269387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:29.380580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-12af0a0d-9353-4fc0-9914-145813ffb5f8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.156121 Jan 05 18:10:29.386306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 263/490] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:29 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:29.484823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9eacc396-ba4e-44d2-95c7-125d4be5a3bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.231589 Jan 05 18:10:29.485505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 228/491] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:29 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:29.951656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:29.958688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:29.967609 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.968330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:29.969278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:29.969890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.110449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:30.120282 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8890c077-5abd-424f-89f1-d1c145147ceb tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1514 microversion: 2.1 time: 0.172744 Jan 05 18:10:30.130861 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 264/492] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:29 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:30.193457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:30.195126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:30.205203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.205962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.206996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.207677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.392978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:30.394067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:30.400311 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.400870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.401783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.402508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.419410 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:30.429212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d3a1d18-820e-4619-a289-484bb9889ef9 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1562 microversion: 2.1 time: 0.241719 Jan 05 18:10:30.430273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 229/493] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:30 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:30.497132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:30.497994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:30.512866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e79b5fc3-f755-499d-a764-3915eb90e79c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.123690 Jan 05 18:10:30.513820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 265/494] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:30 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:30.516663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.519601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.520403 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.520831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.526423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:30.527233 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:30.534446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.534910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.535724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.536164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.639123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5ede47d1-620c-4839-8c60-04a381e7125c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.145474 Jan 05 18:10:30.641580 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 230/495] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:30 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:30.697438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'services' on Instance uuid 4ddb291a-0f29-4cc4-8030-63b5c9bad269 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:10:30.924214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6afea47c-a228-4099-8f92-363f0f346f9b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments/d605615a-e54b-4674-87af-188614b54def" status: 202 len: 0 microversion: 2.1 time: 0.402483 Jan 05 18:10:30.925427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 266/496] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:10:30 2022] DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments/d605615a-e54b-4674-87af-188614b54def => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:30.935475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:30.936987 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:30.957901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.957901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.957901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:30.957901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:30.991301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a033e88-7c8e-492b-bc1b-864a79ffa585 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060838 Jan 05 18:10:30.991798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 231/497] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:10:30 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:31.144398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:31.144398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:31.151952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.152402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.153192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.153618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.193502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-f3522bad-4e22-461c-a288-aed677a45dbc req-d34e0459-4d8a-4a1c-a600-a4ddd38bcb2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b66edc-e5bc-4b66-8a5c-a28a8de81c7f", "name": "network-vif-deleted", "tag": "40c6629f-ad64-4cb1-b51a-e4b9b5b708e5"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:31.196330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:10:31.196330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:10:31.210125 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f3522bad-4e22-461c-a288-aed677a45dbc req-d34e0459-4d8a-4a1c-a600-a4ddd38bcb2f service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.211018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f3522bad-4e22-461c-a288-aed677a45dbc req-d34e0459-4d8a-4a1c-a600-a4ddd38bcb2f service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.246474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-f3522bad-4e22-461c-a288-aed677a45dbc req-d34e0459-4d8a-4a1c-a600-a4ddd38bcb2f service nova] Creating event network-vif-deleted:40c6629f-ad64-4cb1-b51a-e4b9b5b708e5 for instance 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f on hv-cinder-xena0 Jan 05 18:10:31.253523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-f3522bad-4e22-461c-a288-aed677a45dbc req-d34e0459-4d8a-4a1c-a600-a4ddd38bcb2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064522 Jan 05 18:10:31.254404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 232/498] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:10:31.275678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:31.295477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5f84fc74-3b2f-4a71-8fb0-b7727afd22e2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1472 microversion: 2.1 time: 0.160321 Jan 05 18:10:31.296059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 267/499] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:31 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:31.525660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:31.526796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:31.532942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.533610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.534408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.534836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.650302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:31.652827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:31.661367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.662180 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:31.662468 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a5799c4a-52d0-4a46-9383-460acf1e8f03 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.140965 Jan 05 18:10:31.663948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:31.664489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 233/500] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:31 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:31.664874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.003248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:32.004902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:32.014050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.014694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.015673 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.016270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.054342 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c4977886-211e-461a-898b-abde68a62550 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054592 Jan 05 18:10:32.055852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 234/501] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:10:31 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:32.312786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:32.314163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:32.323929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.324476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.325327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.325858 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.368907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.369581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.370299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lazy-loading 'fault' on Instance uuid 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:10:32.387068 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3e22a534-a42f-4b52-9dd1-624de6229884 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.740652 Jan 05 18:10:32.391072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 268/502] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:31 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:32.424584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:32.432867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1fa65efc-8c73-445e-8b11-3ca3b49364fd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1308 microversion: 2.1 time: 0.123976 Jan 05 18:10:32.433530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 235/503] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:32 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1308 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:32.675392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:32.678720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:32.683035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.683480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:32.684278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:32.684709 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:33.066240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:33.067465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:33.081254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:33.082326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:33.088415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:33.088880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:33.136512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9afd6c40-f1aa-4347-8939-dc04123aaeb0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061975 Jan 05 18:10:33.137175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 236/504] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:10:33 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:33.398985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:33.399907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:33.405929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:33.406429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:33.407415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:33.407852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.230850 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b02b3062-fed6-4ec8-b7ef-16ddc3cfd0a4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 3.559146 Jan 05 18:10:36.232612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 269/505] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:32 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 3562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:36.238401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:36.244726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:36.260173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:36.260688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.263218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:36.263860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.322838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0b59de6a-4892-4085-be72-34eb27fdd322 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 2.913815 Jan 05 18:10:36.327264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 237/506] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:33 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 2930 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:36.341362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:36.349463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:36.351790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.353923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lazy-loading 'fault' on Instance uuid 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:10:36.360287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:36.379634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:36.386356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.387340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:36.387998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:36.437789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:36.451385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b8038706-c2b1-4393-add1-46a3e17be296 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 200 len: 1308 microversion: 2.1 time: 0.214914 Jan 05 18:10:36.452139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 270/507] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:36 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:36.471457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9a047676-a0e8-4fd4-8113-f4c971a3559b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145564 Jan 05 18:10:36.472655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 238/508] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:10:36 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:37.243750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:37.245558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:37.257140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.259411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.260252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.260855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.338508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:37.340032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:37.346846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.351300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.351300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.351300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.364244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c5e1b225-1169-4608-b36d-c5cef72e2393 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.124059 Jan 05 18:10:37.365045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 271/509] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:37 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:37.448577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-173d7df7-28c3-46e3-ac51-d606e1ce8421 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.114384 Jan 05 18:10:37.450356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 239/510] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:37 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:37.469802 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:37.470701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:37.486479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:37.487647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.489443 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.491742 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.492594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:37.493147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.525795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.535315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] HTTP exception thrown: Instance 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f could not be found. Jan 05 18:10:37.540763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.544241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:37.545063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:37.547733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Returning 404 to user: Instance 42b66edc-e5bc-4b66-8a5c-a28a8de81c7f could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:10:37.555407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2bd24816-55b4-400b-bf5a-ff428a077a9f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f" status: 404 len: 111 microversion: 2.1 time: 0.089252 Jan 05 18:10:37.561970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 272/511] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:37 2022] GET /compute/v2.1/servers/42b66edc-e5bc-4b66-8a5c-a28a8de81c7f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:10:37.608894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8adbc747-f0f4-4b42-9bd8-5bd0c81c13a5 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128462 Jan 05 18:10:37.614624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 240/512] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:10:37 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:10:38.378919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:38.380553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:38.386833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:38.387291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:38.388080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:38.388519 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:38.467603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:38.468446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:38.485533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:38.485533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:38.485533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:38.485533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:38.488083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-52490c00-aa02-4115-be0d-ac8f253b9723 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.114937 Jan 05 18:10:38.492638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 273/513] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:38 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:38.572092 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f6d0f100-00b0-4589-8708-31f1800fbf89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.113776 Jan 05 18:10:38.573467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 241/514] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:38 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:39.499807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:39.500797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:39.521507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:39.521964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:39.523383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:39.523797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:39.587445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:39.589048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:39.596238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:39.599355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:39.601058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:39.601503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:42.824777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5f17a33f-2d99-4d48-9bbd-55817a56870b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 3.242619 Jan 05 18:10:42.826872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 242/515] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:39 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 3246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:42.839042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f4325ffc-0626-4349-8758-5ffbc0a0ddf0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 3.342814 Jan 05 18:10:42.840477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 274/516] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:39 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 3345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:43.838191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:43.839196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:43.853568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:43.854594 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:43.858446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:43.862622 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:43.863372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:43.864390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:43.865112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:43.869001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:43.872009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:43.872009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:44.027442 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-19460255-45bb-4d9a-88c8-49519f3931f0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.178696 Jan 05 18:10:44.028303 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 275/517] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:43 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:44.061457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6744439f-2766-4b94-bf8d-d1ad701e93eb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.227289 Jan 05 18:10:44.062516 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 243/518] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:43 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:44.856686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1905651564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-591133659", "security_groups": [{"name": "tempest-secgroup-smoke-146799009"}], "networks": [{"uuid": "6cf60f61-fd02-458b-bda3-83bf94350c19"}], "block_device_mapping_v2": [{"uuid": "740f49dc-681e-4929-903a-ecfe10a13899", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:44.972036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] validate_networks() for [('6cf60f61-fd02-458b-bda3-83bf94350c19', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:10:45.040522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:45.042332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:45.049599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.049971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.050796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.051240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.164018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6d811366-238c-41cc-b536-cadd45209b43 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.127809 Jan 05 18:10:45.165202 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 244/519] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:45 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:45.171462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:45.172468 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:45.180083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.180945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.181988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.182675 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.303143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-17cdae31-302c-49f6-be7a-693fd08a64b0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.135755 Jan 05 18:10:45.306057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 245/520] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:45 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:45.405831 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:10:45.406343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:10:45.406810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:10:45.407211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:10:45.407614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:10:45.419555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.419997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.420794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:45.421224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:45.437605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:10:45.441474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Getting quotas for user 81e462cf75ac4791a7a11a8a20754b59 and project 77afa1dabebf479f8d59f54a3d9fad5a. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:10:45.525869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:10:45.528230 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='740f49dc-681e-4929-903a-ecfe10a13899',volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:10:46.143061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fb794618-1b0b-4a9a-935e-81e9b70c4309 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.290453 Jan 05 18:10:46.149410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 276/521] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:10:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:10:46.156879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-213a5664-a84f-4bb0-a9db-b3a2c174af70 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:46.159191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-213a5664-a84f-4bb0-a9db-b3a2c174af70 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:46.178428 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:46.179645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:46.188912 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:46.197352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:46.198593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:46.199001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:46.298750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-213a5664-a84f-4bb0-a9db-b3a2c174af70 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:46.304086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-73cace3c-ed6f-40ae-b886-82a49ef8f58d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.125459 Jan 05 18:10:46.304086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 277/522] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:46 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:10:46.321280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-213a5664-a84f-4bb0-a9db-b3a2c174af70 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1088 microversion: 2.1 time: 0.163791 Jan 05 18:10:46.321280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 246/523] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:46 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1088 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:46.322094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:46.323773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:46.334357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:46.338535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:46.338535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:46.338535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:46.437017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c3ceb8be-34a9-4e43-a800-df068b4fa42e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.124202 Jan 05 18:10:46.441076 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 278/524] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:46 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:10:46.993654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:46.994386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:47.004054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.004504 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.005338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.005909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.036045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:10:47.312479 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:47.313474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:47.321392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.324213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.324213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.324213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.389719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ae15ad69-37cc-4961-8b8c-a4fa6caa7324 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 204 len: 0 microversion: 2.1 time: 0.399989 Jan 05 18:10:47.390636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 247/525] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:10:46 2022] DELETE /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:10:47.395742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9dfe9fa2-1351-47d5-8367-b5f1237f3b50 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:47.400317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9dfe9fa2-1351-47d5-8367-b5f1237f3b50 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:47.496889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9dfe9fa2-1351-47d5-8367-b5f1237f3b50 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:47.504857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9dfe9fa2-1351-47d5-8367-b5f1237f3b50 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1088 microversion: 2.1 time: 0.113067 Jan 05 18:10:47.505607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 248/526] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:47 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1088 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:47.514213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:47.518948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:47.525532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.526306 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.527346 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.528018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.674228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:47.686938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac259921-e3a2-4cf2-9315-2df72599ab30 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1507 microversion: 2.1 time: 0.175209 Jan 05 18:10:47.686938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 249/527] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:47 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:47.698340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:47.699564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:47.706288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.706585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:47.707363 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:47.707797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:51.074053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1f0bb068-e84f-4300-a8bd-085871eb7f62 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 3.765260 Jan 05 18:10:51.074692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 279/528] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:47 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 3767 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:51.079553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:51.080241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:51.086508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:51.086955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:51.087720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:51.088148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:51.092614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8e56b329-7fad-43ea-843f-147b71b7e7bf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 3.399140 Jan 05 18:10:51.096542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 250/529] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:47 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 3409 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:51.098756 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:51.099498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:51.106947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:51.107388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:51.108167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:51.108600 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:51.149554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:51.157310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9ba51e18-1885-423a-b0f1-7cb64dec4b76 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1138 microversion: 2.1 time: 0.081519 Jan 05 18:10:51.158002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 280/530] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:51 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:51.163005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'create', calling method: .version_select at 0x7f7344a203a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-371138591"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:51.180997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:10:51.184918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for user 32b5dfba75e2467bb6b569ec2c833e42 and project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:10:51.236763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:51.245653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a912ce2c-aaee-4849-816e-79e0be0ee083 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1507 microversion: 2.1 time: 0.151279 Jan 05 18:10:51.250691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 251/531] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:51 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:51.408334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:10:51.411962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for user 32b5dfba75e2467bb6b569ec2c833e42 and project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'key_pairs'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:10:51.425377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-de4057b9-0876-4e8c-9ab5-a26c7b2677e1 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.266317 Jan 05 18:10:51.425972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 281/532] 10.222.0.26 () {60 vars in 1157 bytes} [Wed Jan 5 18:10:51 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:51.526411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-463309733", "imageRef": "86bd7378-feda-4772-8054-49b824b706d0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-371138591", "networks": [{"uuid": "39ebef31-4bfe-43bd-a891-f1a646ce4bcd"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:51.576974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] validate_networks() for [('39ebef31-4bfe-43bd-a891-f1a646ce4bcd', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:10:51.806623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-122038889", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "6ea5c4df-8b0d-4950-b450-970791c55261"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:51.863587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] validate_networks() for [('6ea5c4df-8b0d-4950-b450-970791c55261', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:10:52.146361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:10:52.147447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:10:52.148356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:10:52.148773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:10:52.149191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:10:52.158737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.159186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.160031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.160447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.177654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:10:52.182222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Getting quotas for user 32b5dfba75e2467bb6b569ec2c833e42 and project c753dd0d3b2f4098a76e0e6a57614fa4. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:10:52.192939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:10:52.196211 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86bd7378-feda-4772-8054-49b824b706d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:10:52.308922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:10:52.309332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:10:52.309805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:10:52.310369 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:10:52.310785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:10:52.320674 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.321140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.321928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.322392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.338933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Getting quotas for project bc13c6223d1445e0979009edce8585a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:10:52.343150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Getting quotas for user 3f5604b6125c4301aab55b63694331c1 and project bc13c6223d1445e0979009edce8585a8. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:10:52.354595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:10:52.357120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:10:52.375111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a486c3c7-c6c5-40dc-b812-cc801a761eb3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.852551 Jan 05 18:10:52.376104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 252/533] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:10:52.381989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:52.386611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.390332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.390969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.392009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.392655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.482987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-81a4ee03-2e81-4fdc-9573-12c954c54e5d tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680343 Jan 05 18:10:52.493774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f80e1ace-b43a-4f4a-abf8-a30d27e3e04f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.116298 Jan 05 18:10:52.495239 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 253/534] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:52 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:52.500597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 282/535] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 18:10:52.502588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:52.505386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.513852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:52.520179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.521539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.523845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.524309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.525202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.525737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.533044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.535477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.536702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.617713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:52.628052 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3cc38b9a-7ecd-4de2-9b7d-a73d28ab8887 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1204 microversion: 2.1 time: 0.125477 Jan 05 18:10:52.628842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 283/536] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:52 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1204 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:52.635390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:52.636004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.643710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.644448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.645925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:52.646415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:52.673423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1d45dd2a-c222-41cf-a1ea-b0ecbf260978 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.176490 Jan 05 18:10:52.674408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 254/537] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:52 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:52.682553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec1b9232-26ff-44ee-9a0d-3e65a3be1206 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:52.684039 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ec1b9232-26ff-44ee-9a0d-3e65a3be1206 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.751944 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec1b9232-26ff-44ee-9a0d-3e65a3be1206 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:52.760129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ec1b9232-26ff-44ee-9a0d-3e65a3be1206 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1257 microversion: 2.1 time: 0.084390 Jan 05 18:10:52.760909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 255/538] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:52 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:52.769870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5b888336-d7ae-4651-9cb3-2313aa906d19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:52.769870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5b888336-d7ae-4651-9cb3-2313aa906d19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:52.828736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5b888336-d7ae-4651-9cb3-2313aa906d19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:52.836827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5b888336-d7ae-4651-9cb3-2313aa906d19 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1218 microversion: 2.1 time: 0.074806 Jan 05 18:10:52.839789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 256/539] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:52 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:52.872285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:52.881876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0618fcf3-8c1b-4d94-8eaf-2c72c2464089 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1507 microversion: 2.1 time: 0.250184 Jan 05 18:10:52.882430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 284/540] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:52 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:53.504542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:53.505452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.511571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.512019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.513312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.513806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.608775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-65b71df4-21e6-45a9-a881-6e4731aef4d5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.107662 Jan 05 18:10:53.609478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 257/541] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:53 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:53.647523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:53.648763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.654913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.655578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.656528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.657123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.691361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:53.692449 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.698568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.699016 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.699994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.700428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.813961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:53.821787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-89bb5027-8a39-4b2f-a9d0-8d842345749d tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1271 microversion: 2.1 time: 0.177918 Jan 05 18:10:53.822398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 285/542] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:53 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:53.826590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:53.827191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.832651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.833106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.833925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.834949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.924335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:53.932707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7e09ee65-1c30-4937-8930-25d25d7f2a78 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1261 microversion: 2.1 time: 0.109307 Jan 05 18:10:53.933402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 286/543] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:53 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:53.951873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:53.952822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.953154 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-94f39150-5fa0-4b63-a63a-db55e6692214 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.269806 Jan 05 18:10:53.957509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 258/544] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:53 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:53.963159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:53.963159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:53.964502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.965127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.966584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.967182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.969382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.969835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:53.970733 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:53.971171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.046096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:54.053845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df48ee92-8974-48bd-97b8-24534a22d0cd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1214 microversion: 2.1 time: 0.105786 Jan 05 18:10:54.061021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 287/545] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:53 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:54.153431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:54.160787 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-73d2177f-33ae-4a6c-972d-d4c02709d6f4 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1507 microversion: 2.1 time: 0.204519 Jan 05 18:10:54.161353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 259/546] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:53 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:54.301098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-64b6d61f-dce8-4ac6-82a2-b45f8b0d4304 req-e56515d3-833a-47dc-afe6-185c03cf9bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:54.312345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:10:54.312345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:10:54.312345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-64b6d61f-dce8-4ac6-82a2-b45f8b0d4304 req-e56515d3-833a-47dc-afe6-185c03cf9bfc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.313299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-64b6d61f-dce8-4ac6-82a2-b45f8b0d4304 req-e56515d3-833a-47dc-afe6-185c03cf9bfc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.326680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-64b6d61f-dce8-4ac6-82a2-b45f8b0d4304 req-e56515d3-833a-47dc-afe6-185c03cf9bfc service nova] Creating event network-changed:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:10:54.331737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-64b6d61f-dce8-4ac6-82a2-b45f8b0d4304 req-e56515d3-833a-47dc-afe6-185c03cf9bfc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036200 Jan 05 18:10:54.332454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 288/547] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:54.621441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:54.622542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:54.628501 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.628943 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.629707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.630175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.836374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a60ae5fb-de62-4fc3-a47f-e8a3683ef394 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.218343 Jan 05 18:10:54.837881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 260/548] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:54 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:54.839242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:54.840691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:54.847137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.847701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.848575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.849104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.960337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:54.960337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:54.960337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.960337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:54.960767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:54.960767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.027061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:55.036173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8d105fae-4b0b-4e47-b33c-e248e4336b4e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1253 microversion: 2.1 time: 0.090555 Jan 05 18:10:55.049592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 261/549] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:54 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1253 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:55.057884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:55.059948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:55.070278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:55.086269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ff25a88e-f7f4-484e-8edb-3075aaa636c1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.247087 Jan 05 18:10:55.086397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.086397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.086606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 289/550] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:54 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:55.087619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.088073 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.096092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:55.096704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:55.105031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.105753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.106804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.107400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.185942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:55.193209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f2e00f54-d599-4f77-8a6b-15086142743b tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1270 microversion: 2.1 time: 0.106148 Jan 05 18:10:55.202776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 290/551] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:55 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:55.202776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:55.202776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:55.205254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.205706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.206563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.206999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.230196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2fd7634a-2b23-4465-b85e-1035cacacebd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.177506 Jan 05 18:10:55.231833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 262/552] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:55 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:55.391539 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:55.400223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-50c49882-e28a-456a-a127-50c5fc4d0ab3 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1507 microversion: 2.1 time: 0.204983 Jan 05 18:10:55.402499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 291/553] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:55 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:55.850416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:55.852379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:55.859238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.859786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:55.860683 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:55.861218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.056323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:56.056959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:56.063000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.063463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.064232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.064666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.139586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:56.149604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6d0a384f-0a23-40b5-8578-b617aee4b123 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1327 microversion: 2.1 time: 0.096579 Jan 05 18:10:56.149604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 292/554] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:56 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:56.153404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:56.154000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:56.160623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.161092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.161842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.162410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.309010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:56.316530 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f34e794a-291c-4f8f-a391-d60909933a8a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.166414 Jan 05 18:10:56.317112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 293/555] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:56 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:56.322504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:56.323106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:56.328975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.329429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.330255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.330695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.400519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d5f6fa2a-01b0-4372-a743-34321fd230f9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 0.554924 Jan 05 18:10:56.401173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 263/556] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:55 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:10:56.406386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:56.407578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:56.416980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.417437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.418260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.418705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.473054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:56.481255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1f33b5f4-70c2-4d97-b65f-d7d44b1ff97a tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.163194 Jan 05 18:10:56.482168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 294/557] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:56 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:56.486880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-abbcf47c-843b-41a7-be45-040e72c1b7e4 req-71f4ad2e-c150-4902-90f2-e1d8a86cdc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc46c6-cb73-4f7e-806b-4e68fdf9c293", "name": "network-vif-deleted", "tag": "7996838c-af81-4f6b-8afa-9b8a7c826137"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:56.488412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:10:56.488412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:10:56.497350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-abbcf47c-843b-41a7-be45-040e72c1b7e4 req-71f4ad2e-c150-4902-90f2-e1d8a86cdc4b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.497795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-abbcf47c-843b-41a7-be45-040e72c1b7e4 req-71f4ad2e-c150-4902-90f2-e1d8a86cdc4b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.509048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-abbcf47c-843b-41a7-be45-040e72c1b7e4 req-71f4ad2e-c150-4902-90f2-e1d8a86cdc4b service nova] Creating event network-vif-deleted:7996838c-af81-4f6b-8afa-9b8a7c826137 for instance 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 on hv-cinder-xena0 Jan 05 18:10:56.513934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-abbcf47c-843b-41a7-be45-040e72c1b7e4 req-71f4ad2e-c150-4902-90f2-e1d8a86cdc4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030621 Jan 05 18:10:56.514578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 295/558] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:10:56.522063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:56.522753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:56.528722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.529170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.529945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.530424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.532144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0b79caf8-3571-4fec-98bf-be77d05cb8ec tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28184 microversion: 2.20 time: 0.129430 Jan 05 18:10:56.533781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 264/559] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:56 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28184 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:10:56.565333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:56.565787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:56.566279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'fault' on Instance uuid 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:10:56.610264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:56.621681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e16f998-6d23-4805-9aa3-b3cb7c9b5d40 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 200 len: 1312 microversion: 2.1 time: 0.103207 Jan 05 18:10:56.623122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 296/560] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:56 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:57.166181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:57.166953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:57.185144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.185583 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.186396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.186908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.335609 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:57.336545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:57.354679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.354679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.354679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.354679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.437755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:57.449442 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b7471c92-1ddb-4c2f-9104-c51aed79f80d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.288150 Jan 05 18:10:57.460247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 265/561] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:57 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:57.465559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:57.466810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:57.474489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.475463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.476608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.477228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.556635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:57.574561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-85e54b66-0e3a-41de-9813-fa4c2b8d0723 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.244237 Jan 05 18:10:57.575735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 297/562] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:57 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:10:57.580242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:10:57.581143 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:57.595564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.596324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.597351 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.597801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.944534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:10:57.952287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0889561f-4970-4fbf-835c-547b5fb71ead tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.375390 Jan 05 18:10:57.952857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 298/563] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:10:57 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:10:57.964072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:10:57.965365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:10:57.971357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.971787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:10:57.972558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:10:57.972988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.788812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-39ed1273-ec15-4061-93b1-ffcc6207dd64 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 15.834689 Jan 05 18:11:13.791939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 299/564] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:10:57 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 15837 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:13.796232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-452d6c08-8980-4bc5-a725-48023e3278f5 req-4d49df45-6131-47f9-934b-684efa62f473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f02911-1ce0-4c13-9006-ac6f05ae4a45", "tag": "5a020fa7-9166-4830-bf8c-76aadb9d4ebd"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:13.797827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:13.797827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:11:13.805994 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-452d6c08-8980-4bc5-a725-48023e3278f5 req-4d49df45-6131-47f9-934b-684efa62f473 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.806465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-452d6c08-8980-4bc5-a725-48023e3278f5 req-4d49df45-6131-47f9-934b-684efa62f473 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.819198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-452d6c08-8980-4bc5-a725-48023e3278f5 req-4d49df45-6131-47f9-934b-684efa62f473 service nova] Creating event network-changed:5a020fa7-9166-4830-bf8c-76aadb9d4ebd for instance 67f02911-1ce0-4c13-9006-ac6f05ae4a45 on hv-cinder-xena0 Jan 05 18:11:13.824551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-452d6c08-8980-4bc5-a725-48023e3278f5 req-4d49df45-6131-47f9-934b-684efa62f473 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032733 Jan 05 18:11:13.825445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 300/565] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:13.832258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:13.832258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 16fc46c6-cb73-4f7e-806b-4e68fdf9c293] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:13.834427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-dd98b4f8-f086-4bc6-9156-67c41953eabd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 28615 microversion: 2.1 time: 16.372803 Jan 05 18:11:13.835081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 266/566] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:10:57 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 28615 bytes in 16376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:13.841165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:13.841866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:13.844942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.846511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.847573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.848225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.849064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.849704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.854954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.854954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.867351 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] HTTP exception thrown: Instance 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 could not be found. Jan 05 18:11:13.868684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Returning 404 to user: Instance 16fc46c6-cb73-4f7e-806b-4e68fdf9c293 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:13.869898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1b5e0b67-84b7-4093-aaf2-ed883d91857f tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293" status: 404 len: 111 microversion: 2.1 time: 0.043119 Jan 05 18:11:13.871176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 301/567] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:13 2022] GET /compute/v2.1/servers/16fc46c6-cb73-4f7e-806b-4e68fdf9c293 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:11:13.879104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:13.885042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:13.889603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.891012 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:13.892667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:13.893323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.024010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:14.032367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7add09d5-4f88-4cdc-bc66-311bbc5912f8 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.159762 Jan 05 18:11:14.035077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 302/568] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:13 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:14.037282 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:14.037893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:14.044394 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.044976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.045634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.046127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.200743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:14.217157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d76a4445-8e21-4a7a-a980-8b7824992e69 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.183075 Jan 05 18:11:14.229667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 303/569] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:14 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:14.235103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:14.239073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:14.243551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.244115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.244976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.245421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.284079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:11:14.481433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:14.489819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4f4fffb5-f4f0-49d0-8f96-6db5af088f4a tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.652782 Jan 05 18:11:14.490421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 267/570] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:13 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:14.669854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c5f97d98-e56a-42de-bfba-1669a689bdfa tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 204 len: 0 microversion: 2.1 time: 0.438706 Jan 05 18:11:14.673516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 304/571] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:11:14 2022] DELETE /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:11:14.682494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:14.684372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:14.697988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.700601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.701102 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.702341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.801590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:14.802611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:14.812858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.813595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.815103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.815696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.969070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-76877839-694d-4b18-a2d1-6a4a059579cf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.171220 Jan 05 18:11:14.971321 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 305/572] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:14 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:14.981248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:14.982377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:14.989431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.993492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:14.993492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:14.993492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.033909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:15.041568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-233445d8-c50a-4156-8cd2-8cd71464a75c tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.363980 Jan 05 18:11:15.047400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 268/573] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:14 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:15.055745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:15.056841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:15.075992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.076729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.077697 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.078307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.131048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e8b52c61-d0f0-46ef-a428-c7036db31b55 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 29120 microversion: 2.1 time: 0.158041 Jan 05 18:11:15.132043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 306/574] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:14 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 29120 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:15.235134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:15.235848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:15.252527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.252527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.253131 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.253533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.297022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:15.307591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-94590237-34a3-476b-9c24-0377842e9495 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.255563 Jan 05 18:11:15.309387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 269/575] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:15 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:15.510048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:15.513433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:15.529243 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.530083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.532889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.537080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.783401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:15.796263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4a716bfd-8938-4811-97ba-e1edb5c439ed tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.565072 Jan 05 18:11:15.799334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 307/576] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:15 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:15.841546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-5556a75c-b02f-420a-a15f-329b9b18da9a req-41210af2-4cd7-4dda-afca-e94d28b5f764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:15.843104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:15.843104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:11:15.851263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-5556a75c-b02f-420a-a15f-329b9b18da9a req-41210af2-4cd7-4dda-afca-e94d28b5f764 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:15.852077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-5556a75c-b02f-420a-a15f-329b9b18da9a req-41210af2-4cd7-4dda-afca-e94d28b5f764 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:15.865737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-5556a75c-b02f-420a-a15f-329b9b18da9a req-41210af2-4cd7-4dda-afca-e94d28b5f764 service nova] Creating event network-changed:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:11:15.871680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-5556a75c-b02f-420a-a15f-329b9b18da9a req-41210af2-4cd7-4dda-afca-e94d28b5f764 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033981 Jan 05 18:11:15.872586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 308/577] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:15.934404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:15.953290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-904f7935-92f5-438a-bee8-8ee8c09c254e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.449344 Jan 05 18:11:15.954963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 270/578] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:15 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:15.986042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:15.987326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.001968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.002652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.005092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.005798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.067433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:16.068045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.081369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.082140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.085056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.091213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.292774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ae26bdbb-1517-41af-87b9-a0c7b1dd6ebb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.314037 Jan 05 18:11:16.297892 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 309/579] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:15 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:16.307114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:16.308758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.347454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.347904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.348694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.349130 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.457103 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:16.466511 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e7927d8a-a479-4fd1-bd6b-31e538f408e2 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.404659 Jan 05 18:11:16.477596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 271/580] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:16 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:16.482948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:16.488707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.490700 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.491180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.491963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.493356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.720268 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:16.730038 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fd087525-c327-4f52-9827-bd779498b9af tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.250877 Jan 05 18:11:16.733379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 272/581] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:16 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:16.748782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bca4794d-7d3d-44ed-aa3a-1ab707c451a2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 31629 microversion: 2.1 time: 0.448726 Jan 05 18:11:16.752934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 310/582] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:16 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 31629 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:16.812330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:16.813191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.819198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.819643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.821770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.823314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.972063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:16.974129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:16.981324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.981765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:16.982919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:16.983648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.059196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:17.069964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-049b6762-ae38-4e5d-a536-14f6f90fa3f3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.261100 Jan 05 18:11:17.072494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 273/583] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:16 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:17.162442 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:17.172044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7bde6d42-91a0-4de2-b649-cd81a712a5f8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.204079 Jan 05 18:11:17.172631 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 311/584] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:16 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:17.304988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:17.306728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:17.323838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.326328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.331874 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.331874 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.431236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f93ee2bb-6ff9-49fa-9c1a-65a619168c5e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.129766 Jan 05 18:11:17.432584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 274/585] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:17 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:17.484508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:17.485139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:17.491882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.492330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.493664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.494116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.641264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:17.649461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bb78b3f7-b0c7-4a97-b3b9-535f37525c53 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.168388 Jan 05 18:11:17.659176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 312/586] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:17 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:17.749906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:17.750653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:17.757592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.759227 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.760220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.760689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:17.761021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.761672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:17.774492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.775032 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:17.775821 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:17.776256 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.035484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-48d50a99-0d72-4e40-af84-dd8dfa7feebf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 33152 microversion: 2.1 time: 0.278471 Jan 05 18:11:18.038039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 313/587] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:17 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 33152 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:18.050405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:18.065140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0fe9c503-c271-4be4-8ee9-7f12a457d383 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.319451 Jan 05 18:11:18.066658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 275/588] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:17 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:18.088340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:18.089030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:18.096033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.096478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.097252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.097681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.188647 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:18.189255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:18.199273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.199942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.200894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.202387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.279674 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:18.287703 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bdde2a7f-4922-42ae-a0fb-6209d3b3be90 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.203053 Jan 05 18:11:18.301628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 314/589] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:18 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:18.447029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:18.448844 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:18.450405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:18.459456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5a55b410-a50b-45b7-a1dd-2d0216bb9c02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.274581 Jan 05 18:11:18.462824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.463997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 276/590] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:18 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:18.464755 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.465945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.466617 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.666998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:18.667781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:18.672604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-55b63bf5-63d6-4f76-89a7-227c2ee3c1b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.230627 Jan 05 18:11:18.673950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.674503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 315/591] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:18 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:18.674810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.675617 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:18.676235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:18.897469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:18.905021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-580f521f-a8cf-4487-9c28-57ddc0e3b38b tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.242019 Jan 05 18:11:18.905586 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 277/592] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:18 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:19.056846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:19.058051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.065792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.066464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.067257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.067692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.082592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:19.083217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.091847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.092394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.093744 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.094282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.294664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d0a4dac8-e3c0-4566-abc1-1188c872e80a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 33847 microversion: 2.1 time: 0.249261 Jan 05 18:11:19.295591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 316/593] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:19 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 33847 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:19.306726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:19.307728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.315982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.315982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.316346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.316780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.318898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:19.327669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eaff8837-dfc5-4990-86fb-73def010cb83 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.248848 Jan 05 18:11:19.337154 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 278/594] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:19 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:19.480651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:19.480913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:19.481634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.488267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-31ec368a-b0b1-4121-bf87-47df68602709 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.186100 Jan 05 18:11:19.489593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 317/595] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:19 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:19.491996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.494172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.495041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.495486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.686824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:19.688554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.697636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.698113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.699086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.699526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.716589 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:19.724265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fbe35cba-e8d6-4e48-acd8-a04f9bfff736 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.247911 Jan 05 18:11:19.725026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 279/596] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:19 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:19.906157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-42d95000-6f54-4950-94e3-5d0db2592a33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.224282 Jan 05 18:11:19.906740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 318/597] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:19 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:19.921504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:19.922221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:19.928527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.929110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.929796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:19.930910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:19.945433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Action: 'create', calling method: .version_select at 0x7f7346753940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-84115276"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:19.963030 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for project 08e68392448c4624aa2ae32698c65e8d. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:11:19.966814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for user 15c202797c1440e1beb37e997904ac04 and project 08e68392448c4624aa2ae32698c65e8d. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:11:20.056450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:20.064399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1fbf5a66-b895-48c5-9a55-529e258f6f17 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.146673 Jan 05 18:11:20.065188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 319/598] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:19 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:20.308034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:20.309730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:20.316286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.319685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.321407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.322182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.380671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for project 08e68392448c4624aa2ae32698c65e8d. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:11:20.385044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for user 15c202797c1440e1beb37e997904ac04 and project 08e68392448c4624aa2ae32698c65e8d. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:11:20.401558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-676540fe-389a-43e2-879c-21b8e4740d8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.612846 Jan 05 18:11:20.402200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 280/599] 10.222.0.26 () {60 vars in 1157 bytes} [Wed Jan 5 18:11:19 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:20.406486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:20.407153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:20.413443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.419386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.419386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.419386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.476552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9beb251b-7838-4f23-a845-e84a813a73f7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 34983 microversion: 2.1 time: 0.172841 Jan 05 18:11:20.479104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 320/600] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:20 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 34983 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:20.511050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:20.511360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:20.534403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.534761 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.535559 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.536615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.554724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:20.568459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6b1260cf-a50d-49ed-afb2-c24e5f650339 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.164631 Jan 05 18:11:20.570198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 281/601] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:20 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:20.703825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:20.712227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d60f68d8-3ffa-40d0-968f-d3e85c284ce6 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.209035 Jan 05 18:11:20.713098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 321/602] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:20 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:20.742116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:20.743276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:20.749064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.749589 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.750502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.751020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.881577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:20.889034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f766e745-f6d4-4cce-b783-6f1f7d1aa892 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.150798 Jan 05 18:11:20.889804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 282/603] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:20 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:20.918951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:20.920035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:20.925996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.926478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:20.927427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:20.927863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.080517 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:21.081125 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:21.087104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.087554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.088330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.088772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.144878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-380131ca-279c-459c-ba8a-3362f11839ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.230408 Jan 05 18:11:21.146611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 322/604] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:20 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:21.220146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:21.226921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4dc7e562-5329-457f-8a8b-ef8b907d422a tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.149910 Jan 05 18:11:21.227867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 283/605] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:21 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:21.489867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:21.490922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:21.498429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.498873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.499652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.500092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.585723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:21.586406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:21.601926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.603017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.603930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.604249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.618280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-164bed25-59cb-431a-aa03-d7b9c9f80680 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 36043 microversion: 2.1 time: 0.131718 Jan 05 18:11:21.619578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 323/606] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:21 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 36043 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:21.730059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:21.731101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:21.739051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.742036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.742991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.743883 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.905277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:21.914528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-874ee54d-d02c-4c53-b1fc-0392518ab242 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.332184 Jan 05 18:11:21.918910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:21.919949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 284/607] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:21 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:21.927764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-89cee5ba-fd16-4122-8a26-0dd7bc12f94e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.200887 Jan 05 18:11:21.928318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:21.929338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:21.931759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 324/608] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:21 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:21.957098 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.957455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:21.967524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:21.967524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.157867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:22.159941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:22.175359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.175843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.176765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.177388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.361200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-866039dc-473a-4de1-99da-deb736718b1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.207661 Jan 05 18:11:22.365151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 325/609] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:22 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:22.368504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:22.369511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:22.378245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.378903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.379891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.380375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.425731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:22.437445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b250eab0-8eee-4b2a-afb7-da1c1708d14e tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.512340 Jan 05 18:11:22.438887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 285/610] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:21 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:22.570103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:22.581418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-34157db9-f46f-41d4-b194-d9b1324f6e80 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1522 microversion: 2.1 time: 0.216532 Jan 05 18:11:22.583195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 326/611] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:22 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:22.630811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:22.631913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:22.655961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.656419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.657639 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.658153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.760518 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-c537aaf1-cb18-42af-9d20-42649f7d52bb req-bc3ff37b-3394-44f5-9e39-99929cbc64be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ddb291a-0f29-4cc4-8030-63b5c9bad269", "name": "network-vif-deleted", "tag": "df48552c-b3ac-4d6c-9e6d-2d520990ed4f"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:22.761995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:22.761995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:11:22.769702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-c537aaf1-cb18-42af-9d20-42649f7d52bb req-bc3ff37b-3394-44f5-9e39-99929cbc64be service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.774955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-c537aaf1-cb18-42af-9d20-42649f7d52bb req-bc3ff37b-3394-44f5-9e39-99929cbc64be service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.787035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e1c23bbc-c02c-4d5e-a8bf-95b812d1ecab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 37613 microversion: 2.1 time: 0.159775 Jan 05 18:11:22.792626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-c537aaf1-cb18-42af-9d20-42649f7d52bb req-bc3ff37b-3394-44f5-9e39-99929cbc64be service nova] Creating event network-vif-deleted:df48552c-b3ac-4d6c-9e6d-2d520990ed4f for instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 on hv-cinder-xena0 Jan 05 18:11:22.794287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 286/612] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:22 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 37613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:22.797975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-c537aaf1-cb18-42af-9d20-42649f7d52bb req-bc3ff37b-3394-44f5-9e39-99929cbc64be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041444 Jan 05 18:11:22.804369 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 327/613] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:22.939149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:22.940138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:22.949693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:22.951899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:22.962514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.962985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.963791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.964182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.964327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.964998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:22.967702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:22.969816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.139073 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:23.150402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ab52d176-b3eb-47d6-88d2-b762fa77aba7 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.206039 Jan 05 18:11:23.151674 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 328/614] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:22 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:23.189012 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:23.195384 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-61240a52-0f96-4f81-bb92-ba9b2da29756 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.263590 Jan 05 18:11:23.196768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 287/615] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:22 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:23.373176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:23.378306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:23.387495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.388202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.389224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.389665 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.454391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:23.455296 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:23.461828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.462295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.463088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.463518 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.609003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c71557fb-86a3-49a5-8a16-a8ecc0832b97 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.239592 Jan 05 18:11:23.609693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 329/616] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:23 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:23.614678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:23.623300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:23.624006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:23.624620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-57e77ca3-1491-42af-a562-f1241d5af1c3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.173724 Jan 05 18:11:23.625210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 288/617] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:23 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:23.630817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.631484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.632513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.633286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.669173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.669684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.670230 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lazy-loading 'fault' on Instance uuid 4ddb291a-0f29-4cc4-8030-63b5c9bad269 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:11:23.717286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8de0f34c7c1e4d5b90bbab65d6f66efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b4fd64462549c59ae7f47dfc02af1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:23.725074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5efa7c5d-557c-4d3c-8e09-88aec44e5f7d tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 200 len: 1312 microversion: 2.1 time: 0.110421 Jan 05 18:11:23.726135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 330/618] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:23 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:23.800821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:23.801772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:23.810796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.814056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:23.814056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:23.814359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.012776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-88d87de5-2c9c-4b90-afe3-3d834d306be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 38145 microversion: 2.1 time: 0.215521 Jan 05 18:11:24.016986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 289/619] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:23 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 38145 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:24.169358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:24.171801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:24.178051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.178522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.179351 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.179786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.213713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:24.214976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:24.221732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.222370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.223601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.225413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.341995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:24.349524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a6d0a443-687c-449f-a208-994bbeff2bab tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.185471 Jan 05 18:11:24.350608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 331/620] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:24 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:24.377775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:24.386956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-480616b0-0b13-4fd9-a8b3-9b9223eba337 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.177864 Jan 05 18:11:24.387725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 290/621] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:24 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:24.621858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:24.622797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:24.628840 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.629283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.630063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.630496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.641660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:24.642410 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:24.648042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.648491 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.649270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.649705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.732320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2f1c1430-f278-4ec0-a3f7-3f59d6ca27ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.114917 Jan 05 18:11:24.732961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 332/622] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:24 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:24.743836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:24.745211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] [instance: 4ddb291a-0f29-4cc4-8030-63b5c9bad269] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:24.752134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.752585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.753362 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:24.753798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:24.769744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] HTTP exception thrown: Instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 could not be found. Jan 05 18:11:24.770381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] Returning 404 to user: Instance 4ddb291a-0f29-4cc4-8030-63b5c9bad269 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:24.771215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b131c739-abe2-4111-8cbf-09ec673ca0a0 tempest-ServerRescueNegativeTestJSON-1520246884 tempest-ServerRescueNegativeTestJSON-1520246884-project] 10.222.0.26 "GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269" status: 404 len: 111 microversion: 2.1 time: 0.032083 Jan 05 18:11:24.771769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 333/623] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:24 2022] GET /compute/v2.1/servers/4ddb291a-0f29-4cc4-8030-63b5c9bad269 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:11:24.775055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:24.782696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc6aa477-2a54-49db-a71b-65d844bcb165 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.144785 Jan 05 18:11:24.783259 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 291/624] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:24 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:25.024856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:25.025980 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:25.032199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.032768 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.033555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.034247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.136562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-270ed4e4-e948-4102-a5e0-62b96e67e515 req-5cab54bc-c723-4474-8ebf-295aab15946e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "name": "network-vif-plugged", "status": "completed", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:25.138595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:25.138595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:11:25.144901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6d80b0d6-5ad8-4513-a237-94f5eb8ec80e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 38145 microversion: 2.1 time: 0.123718 Jan 05 18:11:25.149389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 334/625] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:25 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 38145 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:11:25.149540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-270ed4e4-e948-4102-a5e0-62b96e67e515 req-5cab54bc-c723-4474-8ebf-295aab15946e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.149540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-270ed4e4-e948-4102-a5e0-62b96e67e515 req-5cab54bc-c723-4474-8ebf-295aab15946e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.158730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-270ed4e4-e948-4102-a5e0-62b96e67e515 req-5cab54bc-c723-4474-8ebf-295aab15946e service nova] Creating event network-vif-plugged:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:11:25.163936 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-270ed4e4-e948-4102-a5e0-62b96e67e515 req-5cab54bc-c723-4474-8ebf-295aab15946e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033980 Jan 05 18:11:25.173892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 292/626] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:25.372361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:25.374707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:25.393348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.394043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.394985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.398358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.405037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:25.405748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:25.426247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.426247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.427147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.428660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.582946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:25.592112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0c61c4fc-3ef3-44bb-9ddd-4da461bcf738 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.227576 Jan 05 18:11:25.603624 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 335/627] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:25 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:25.692118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:25.701919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1d614369-f497-4e04-a0f7-92c9570dd1cd tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.301919 Jan 05 18:11:25.709157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 293/628] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:25 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:25.745209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:25.746059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:25.751904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.752571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.753324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.753756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.799104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:25.799867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:25.805768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.806280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:25.807111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:25.807555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.013488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:26.020606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8a0fad36-e66a-4f93-9182-292f12ef8291 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.225106 Jan 05 18:11:26.021348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 294/629] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:25 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:26.156945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:26.161324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:26.164174 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.164772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.166311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.166311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.467839 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3517b301-7d8c-4803-92c3-b2ebfc39709c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.726958 Jan 05 18:11:26.472999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 336/630] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:25 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:26.561188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-30562c14-bef8-49d0-9415-89e2decf16b2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 38145 microversion: 2.1 time: 0.369699 Jan 05 18:11:26.561188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 295/631] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:26 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 38145 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:26.612581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:26.613403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:26.621926 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.622452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.623263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.623694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.721846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:26.722715 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:26.731140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.731691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.732639 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:26.733150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:26.776145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:26.784279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e2005f8c-a17b-47f0-9bb6-604e50885b86 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.175984 Jan 05 18:11:26.784651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 337/632] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:26 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:26.907537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:26.923436 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cd8f6f76-b261-4f3b-b02f-ad4ccdaafe7f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.206945 Jan 05 18:11:26.924020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 296/633] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:26 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:27.038047 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:27.040684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:27.050371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.051241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.052845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.054173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.181080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f02911-1ce0-4c13-9006-ac6f05ae4a45", "name": "network-vif-plugged", "status": "completed", "tag": "5a020fa7-9166-4830-bf8c-76aadb9d4ebd"}, {"server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "name": "network-vif-plugged", "status": "completed", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:27.187375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:27.187375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:11:27.199980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.200677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.216357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] Creating event network-vif-plugged:5a020fa7-9166-4830-bf8c-76aadb9d4ebd for instance 67f02911-1ce0-4c13-9006-ac6f05ae4a45 on hv-cinder-xena0 Jan 05 18:11:27.216905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] Creating event network-vif-plugged:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:11:27.223402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-02603539-14ff-46aa-a3f8-ef77a921571d req-cbd4405f-e3f9-4678-af87-7b5024bb076d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047060 Jan 05 18:11:27.224143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 297/634] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:27.224505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:27.232939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dabec210-ad77-44a4-8574-c3f295990b02 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.200020 Jan 05 18:11:27.242386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 338/635] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:27 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:27.481657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:27.482693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:27.488872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.489223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.490004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.490418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.563806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:27.563806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:27.576328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.576328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.576328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.576328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.662885 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-42fa4b0a-1c5d-42da-8d46-2e363706fd6e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.186206 Jan 05 18:11:27.663532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 298/636] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:27 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:27.772700 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7b7e0fa2-0647-407a-8c96-789ca7b7345f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 38266 microversion: 2.1 time: 0.215372 Jan 05 18:11:27.777567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 339/637] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:27 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 38266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:27.801691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:27.802442 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:27.809335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.809788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.810688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.811130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.940423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:27.941135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:27.948604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.949048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:27.951838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:27.951838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.005461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:28.013838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ef8721d9-cd7f-49a5-8307-c785dbf0780e tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.215970 Jan 05 18:11:28.014927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 299/638] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:27 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:28.097664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:28.105862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c1f17c2d-d0a2-4b01-ae84-c934e3d22730 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.170153 Jan 05 18:11:28.106490 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 340/639] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:27 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:28.249607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:28.250164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:28.256494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.256973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.257869 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.258860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.410957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:28.436514 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6c90d81f-5198-4151-8efe-aea52ba9c73b tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1357 microversion: 2.1 time: 0.181949 Jan 05 18:11:28.437448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 300/640] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:28 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:28.675298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:28.676221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:28.690175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.690642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.691459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.691923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.784903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:28.785827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:28.792559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.793008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:28.793779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:28.794257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.172346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-47944732-3bce-40f4-91a5-3f23add66923 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.500449 Jan 05 18:11:29.173960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 341/641] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:28 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:29.178805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.179518 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:29.186207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.186649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.187413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.187843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.214140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4593fe9b-f394-4864-a835-1c11c0cb64d8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 200 len: 38274 microversion: 2.1 time: 0.432824 Jan 05 18:11:29.219614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 301/642] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:11:28 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 38274 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:11:29.223088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.223744 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:29.231427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.235796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.236410 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.237287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.355945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:29.363444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3203b3c8-06e5-4809-8a73-c3da5e4b0fe9 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.188646 Jan 05 18:11:29.364026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 342/643] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:29.378157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.378946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:29.385668 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.386165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.386955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.387403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.394645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:29.402608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1a01e75e-f2e2-4372-b9bb-245a2d1bad05 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.186383 Jan 05 18:11:29.403365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 302/644] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:29.415221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b2e90268-effd-48b8-90dc-15cf5984439b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/ips" status: 200 len: 145 microversion: 2.1 time: 0.040615 Jan 05 18:11:29.415796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 343/645] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:29.454111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.454759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:29.460533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.461699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.462651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.463131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.594531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:29.602133 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-80e4599d-ef45-4c63-b6f4-2f58abc594db tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1547 microversion: 2.1 time: 0.151718 Jan 05 18:11:29.602726 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 303/646] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:29.626511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.627300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:29.633866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.634582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.635461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.635975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.786665 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:29.794209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0213d80b-5fe6-48a9-a0fe-9ad72ca725cd tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1547 microversion: 2.1 time: 0.171191 Jan 05 18:11:29.794715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 344/647] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:29.811648 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:29.815263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:29.815263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:11:29.816237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:29.816986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Searching by: {'deleted': False, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4'} {{(pid=116429) get_all /opt/stack/nova/nova/compute/api.py:2905}} Jan 05 18:11:29.824271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.824722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.825523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:29.826123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:29.920747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.multi_cell_list [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116429) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jan 05 18:11:30.018275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c6fda44f-4806-498b-8e60-b2f8552da5c5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210366 Jan 05 18:11:30.018987 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 304/648] 10.222.0.26 () {58 vars in 1124 bytes} [Wed Jan 5 18:11:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:30.028962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:30.029569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:30.035459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.036173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.037009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.037526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.162600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:30.170916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6d4edfa9-b35c-44c3-a978-b16894dcd6a8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1547 microversion: 2.1 time: 0.145504 Jan 05 18:11:30.171478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 345/649] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:30 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:30.187447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:30.188084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:30.194452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.195235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.196150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.196760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.313537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-55108f9b-2ce6-4f45-8915-33c54f6ac0a4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.132411 Jan 05 18:11:30.317853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 305/650] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:30 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:30.383326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:30.384428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:30.391183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.391629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.392396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.392825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.431453 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-22331a6c-21ce-46d3-8f68-cdd46a83ae12 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Action: 'create', calling method: .version_select at 0x7f7344951280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1839066333"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:30.521614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:30.529310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-73c761b4-d09a-4590-82af-4b2a92246cca tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1318 microversion: 2.1 time: 0.151914 Jan 05 18:11:30.540489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 306/651] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:30 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:30.540489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:30.540489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:30.540935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.541381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.542175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:30.542604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:30.669711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:30.676473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e333bdd4-02d4-4a7a-8608-75c276dc449c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1259 microversion: 2.1 time: 0.145468 Jan 05 18:11:30.677075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 307/652] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:30 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:31.197031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-22331a6c-21ce-46d3-8f68-cdd46a83ae12 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.904059 Jan 05 18:11:31.197656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 346/653] 10.222.0.26 () {60 vars in 1154 bytes} [Wed Jan 5 18:11:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 905 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 05 18:11:31.210230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bf8a2d67-5baf-4720-99a0-0eb84315b89a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448e69d0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:31.264946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bf8a2d67-5baf-4720-99a0-0eb84315b89a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 345 microversion: 2.1 time: 0.060207 Jan 05 18:11:31.265601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 308/654] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:31 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:31.326357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:31.327315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:31.333891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.334422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.335378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.335911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.442281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1100d893-a663-4697-8c34-f3d5266b3637 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.119363 Jan 05 18:11:31.443214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 347/655] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:31 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:31.546663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:31.547277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:31.553180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.553632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.558082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.558082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.684806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:31.694238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:31.694929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:31.700201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c2ef9c2a-41e7-4fe7-b79b-cd93e6896f88 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1508 microversion: 2.1 time: 0.157604 Jan 05 18:11:31.704008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 309/656] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:31 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:31.707474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.707923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.708695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.709124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.718751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "457e0b9f-fee8-4951-8141-c3483420d7db", "device": "/dev/sdb"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:31.719899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:31.725786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.726258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.727537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.727963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.852801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:31.860437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0e224917-90f0-4cbd-b901-223d7d56e838 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1442 microversion: 2.1 time: 0.170659 Jan 05 18:11:31.861010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 348/657] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:31 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:11:31.883679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:31.884287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:31.890196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.890650 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:31.891428 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:31.891891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:32.012661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:11:32.020209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-23edb82a-ee8d-4598-a363-dfe35f538092 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1442 microversion: 2.1 time: 0.140334 Jan 05 18:11:32.020764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 349/658] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:11:31 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1442 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:11:32.277903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2a302534-f941-4127-92a1-f31c39b3380d tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7345378b80>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:32.332441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2a302534-f941-4127-92a1-f31c39b3380d tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 345 microversion: 2.1 time: 0.058670 Jan 05 18:11:32.333011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 350/659] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:32 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:32.381258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5ef328ca-27a1-4a3f-9fa9-2cbc84aa05ff tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "POST /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665884 Jan 05 18:11:32.381908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 310/660] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:11:31 2022] POST /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:32.454508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:32.455497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:32.461609 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:32.462101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:32.462876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:32.463321 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:32.578081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8ab46b20-1da3-4bec-a51a-f5c2b75897cc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.127087 Jan 05 18:11:32.578765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 351/661] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:32 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:33.346095 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5949fa80-2551-4163-ae3e-5af4f6512374 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448e68b0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:33.425271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5949fa80-2551-4163-ae3e-5af4f6512374 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 345 microversion: 2.1 time: 0.083772 Jan 05 18:11:33.426197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 311/662] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:33 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:33.484282 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83b08bb4-2f03-46e0-9a68-e35a3de105ba"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:33.491034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:33.492694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:33.493764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:33.494886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:33.495331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:33.590960 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:33.592216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:33.598439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:33.598932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:33.599790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:33.600235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:33.708764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9230a197-6aa8-4f2b-a570-342fb64daf43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.121953 Jan 05 18:11:33.712886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 312/663] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:33 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:34.057573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-6339e925-fa05-4cca-975d-a6e4aa60455f req-2e00a5e7-e9be-4171-ab72-2b7021196faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:34.059275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:11:34.059275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:11:34.066914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6339e925-fa05-4cca-975d-a6e4aa60455f req-2e00a5e7-e9be-4171-ab72-2b7021196faa service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:34.067291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6339e925-fa05-4cca-975d-a6e4aa60455f req-2e00a5e7-e9be-4171-ab72-2b7021196faa service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:34.077910 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-6339e925-fa05-4cca-975d-a6e4aa60455f req-2e00a5e7-e9be-4171-ab72-2b7021196faa service nova] Creating event network-changed:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:11:34.090141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-6339e925-fa05-4cca-975d-a6e4aa60455f req-2e00a5e7-e9be-4171-ab72-2b7021196faa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040943 Jan 05 18:11:34.098089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 313/664] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:34.381998 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-78df8a2a-f997-4a8d-8c45-988de95ccf68 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904707 Jan 05 18:11:34.383295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 352/665] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:11:33 2022] POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:34.438217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aa7f08b9-3cd1-45ee-9c4b-d48075a66cb1 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73449f3430>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:34.506322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aa7f08b9-3cd1-45ee-9c4b-d48075a66cb1 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 346 microversion: 2.1 time: 0.072044 Jan 05 18:11:34.506890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 314/666] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:34 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:34.522412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-deed6260-9d30-412c-8133-4559740c1a70 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Action: 'create', calling method: .version_select at 0x7f7345c6f700>, body: {"snapshot": {"volume_id": "6f502dd1-9393-44fa-90df-1ee0ee945dc3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-688268872"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:34.721474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:34.722564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:34.729944 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:34.730448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:34.731234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:34.731679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:34.828407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc438da0-f060-441e-b600-cb4fc34f9632 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.111120 Jan 05 18:11:34.830187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 315/667] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:34 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:35.014904 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbd64c14-17bc-4ec7-afd1-877d404df473"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:35.016061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:35.022452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:35.022905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:35.024384 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:35.024819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:35.084132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-deed6260-9d30-412c-8133-4559740c1a70 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.567070 Jan 05 18:11:35.085150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 353/668] 10.222.0.26 () {60 vars in 1161 bytes} [Wed Jan 5 18:11:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:35.099911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7380bb4c-23d0-4afa-974e-18639d038db5 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344a24ee0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:35.130093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7380bb4c-23d0-4afa-974e-18639d038db5 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.038103 Jan 05 18:11:35.130744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 354/669] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:35 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:35.141121 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3c381a39-98c2-4bb2-8adc-28eec30c30c4 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344900b80>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:35.170413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3c381a39-98c2-4bb2-8adc-28eec30c30c4 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032924 Jan 05 18:11:35.171006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 355/670] 10.222.0.26 () {58 vars in 1139 bytes} [Wed Jan 5 18:11:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:35.181326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1d8cfea6-67c8-4793-b308-52306938cc4f tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344951430>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:35.211941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1d8cfea6-67c8-4793-b308-52306938cc4f tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.034974 Jan 05 18:11:35.212495 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 356/671] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:35 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:35.827303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-83e1fd15-c988-47a4-a47a-d8947d124eeb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816423 Jan 05 18:11:35.827893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 316/672] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:11:35 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:35.839353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:35.840409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:35.847294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:35.847736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:35.848516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:35.849175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:36.224053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0ff0325c-8b86-4f4a-a7b0-d0f40431b3a4 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344a885e0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:36.253981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0ff0325c-8b86-4f4a-a7b0-d0f40431b3a4 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.033858 Jan 05 18:11:36.254585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 317/673] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:36 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:37.265419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d0908aeb-8bb8-4f41-85ce-45cd0c1a886a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448983a0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:37.293980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d0908aeb-8bb8-4f41-85ce-45cd0c1a886a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.032586 Jan 05 18:11:37.294622 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 318/674] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:37 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:38.306301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0bec3cb9-32e8-4f71-b441-7eb728f2b632 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448e6af0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:38.338494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0bec3cb9-32e8-4f71-b441-7eb728f2b632 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.036468 Jan 05 18:11:38.339058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 319/675] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:38 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:39.351474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-345f7a09-d821-4f2d-9f69-83fd436e7418 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344a88a60>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:39.379564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-345f7a09-d821-4f2d-9f69-83fd436e7418 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.032544 Jan 05 18:11:39.380157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 320/676] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:39 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:40.391818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-88dc777e-ceee-47ed-a794-2fe0dc414474 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73449f3c10>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:40.419489 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-88dc777e-ceee-47ed-a794-2fe0dc414474 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.031523 Jan 05 18:11:40.420029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 321/677] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:40 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:41.430770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4c259b36-ae3d-48c4-b05a-f24bb8339132 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448f2d30>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:41.458631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4c259b36-ae3d-48c4-b05a-f24bb8339132 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.031474 Jan 05 18:11:41.459184 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 322/678] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:41 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:42.292953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d1db040c-5232-4a2a-845b-3b7e29739e6c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 6.457390 Jan 05 18:11:42.296794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 357/679] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:35 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 6459 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:42.470676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c064ae1d-1648-4f41-a6de-313b38e7a070 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73449f3430>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:42.499717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c064ae1d-1648-4f41-a6de-313b38e7a070 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.032549 Jan 05 18:11:42.500275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 323/680] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:42 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:43.304857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:43.306471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:43.313147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:43.313681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:43.314545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:43.314982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:43.516612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-95ac034c-7eaa-455a-b7c2-690beaafd320 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73448e6af0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:43.541013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-95ac034c-7eaa-455a-b7c2-690beaafd320 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 287 microversion: 2.1 time: 0.032911 Jan 05 18:11:43.541561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 324/681] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:43 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:11:43.551114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ce87535c-dc39-4f7e-9ec6-4f14c5f9b27a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344a74430>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:43.591960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d00a25bc-67e6-4df0-a1d8-803a6841b1db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.290835 Jan 05 18:11:43.592642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 358/682] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:43 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:43.771602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ce87535c-dc39-4f7e-9ec6-4f14c5f9b27a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 202 len: 0 microversion: 2.1 time: 0.223841 Jan 05 18:11:43.778477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 325/683] 10.222.0.26 () {58 vars in 1253 bytes} [Wed Jan 5 18:11:43 2022] DELETE /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:43.786990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-10afaa43-a8c5-46ad-b87e-8ea546d5ef08 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344951b80>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:43.872770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-10afaa43-a8c5-46ad-b87e-8ea546d5ef08 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 200 len: 286 microversion: 2.1 time: 0.089719 Jan 05 18:11:43.873344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 359/684] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:43 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:44.602798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:44.607954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:44.613940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:44.613940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:44.613940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:44.613940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:44.739969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5c5f59ac-1626-4bc9-a1a5-0c16c20dea00 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.140992 Jan 05 18:11:44.744571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 326/685] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:44 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:44.885869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a889c312-6146-4cd5-bb9c-54ffb74b1bd7 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7345c6f4c0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:44.909441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-a889c312-6146-4cd5-bb9c-54ffb74b1bd7 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] HTTP exception thrown: Snapshot 97b218a6-eda0-4209-b617-f5ec85724d4f could not be found. Jan 05 18:11:44.910852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a889c312-6146-4cd5-bb9c-54ffb74b1bd7 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Returning 404 to user: Snapshot 97b218a6-eda0-4209-b617-f5ec85724d4f could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:44.911685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a889c312-6146-4cd5-bb9c-54ffb74b1bd7 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f" status: 404 len: 111 microversion: 2.1 time: 0.030953 Jan 05 18:11:44.912367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 360/686] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:11:44 2022] GET /compute/v2.1/os-snapshots/97b218a6-eda0-4209-b617-f5ec85724d4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:11:44.920599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fa565c8a-1977-4f6c-9daa-633ae387bd4a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344898940>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:45.102492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fa565c8a-1977-4f6c-9daa-633ae387bd4a tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 202 len: 0 microversion: 2.1 time: 0.185566 Jan 05 18:11:45.103630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 327/687] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:11:44 2022] DELETE /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:45.111676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-511acc78-01b2-41d7-a86a-efc6bcaeab3c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f7344a1e1f0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:45.192228 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-511acc78-01b2-41d7-a86a-efc6bcaeab3c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 345 microversion: 2.1 time: 0.084153 Jan 05 18:11:45.192788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 361/688] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:45 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:45.752356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:45.753444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:45.760688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:45.764913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:45.764913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:45.764913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:45.864561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0ffbb80b-fe38-47a7-907e-c60ddcc967c5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.115864 Jan 05 18:11:45.865195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 328/689] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:45 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:46.203411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4c577001-f258-4392-838d-4d5870554840 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73449001f0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:46.253751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4c577001-f258-4392-838d-4d5870554840 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 200 len: 345 microversion: 2.1 time: 0.053795 Jan 05 18:11:46.254444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 362/690] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:46 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:11:46.876892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:46.877918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:46.885047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:46.885506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:46.886310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:46.886749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:47.266572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-27b08e80-1054-4d2b-9ac1-46b18caaf349 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f734490f5e0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:47.293942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-27b08e80-1054-4d2b-9ac1-46b18caaf349 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] HTTP exception thrown: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. Jan 05 18:11:47.294544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-27b08e80-1054-4d2b-9ac1-46b18caaf349 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Returning 404 to user: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:47.295344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-27b08e80-1054-4d2b-9ac1-46b18caaf349 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 404 len: 109 microversion: 2.1 time: 0.032889 Jan 05 18:11:47.295876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 363/691] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:47 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:11:47.308908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b85344b7-1de5-4107-bb2c-43b23b1d2e4c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f734490f430>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:47.334861 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-b85344b7-1de5-4107-bb2c-43b23b1d2e4c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] HTTP exception thrown: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. Jan 05 18:11:47.335431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b85344b7-1de5-4107-bb2c-43b23b1d2e4c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Returning 404 to user: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:47.336220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b85344b7-1de5-4107-bb2c-43b23b1d2e4c tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 404 len: 109 microversion: 2.1 time: 0.030741 Jan 05 18:11:47.336727 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 364/692] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:11:47 2022] DELETE /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:11:47.345091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a51e688-6318-4a2a-b162-bbb4dcce70c6 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Calling method '.version_select at 0x7f73449bb0d0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:11:47.370233 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-7a51e688-6318-4a2a-b162-bbb4dcce70c6 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] HTTP exception thrown: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. Jan 05 18:11:47.370815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a51e688-6318-4a2a-b162-bbb4dcce70c6 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] Returning 404 to user: Volume 6f502dd1-9393-44fa-90df-1ee0ee945dc3 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:11:47.371622 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7a51e688-6318-4a2a-b162-bbb4dcce70c6 tempest-VolumesSnapshotsTestJSON-1691133888 tempest-VolumesSnapshotsTestJSON-1691133888-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3" status: 404 len: 109 microversion: 2.1 time: 0.030321 Jan 05 18:11:47.372133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 365/693] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:11:47 2022] GET /compute/v2.1/os-volumes/6f502dd1-9393-44fa-90df-1ee0ee945dc3 => generated 109 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:11:51.405413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3a34161d-fec4-4715-89c2-d304fe7a98ee tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 4.532224 Jan 05 18:11:51.406047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 329/694] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:46 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 4534 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:52.417093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:52.418204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:52.424890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:52.425343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:52.427851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:52.427851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:53.317132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-61312dfd-1aeb-4381-a4d9-bc73d4979cb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.903976 Jan 05 18:11:53.317776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 366/695] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:52 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:54.329303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:54.330328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:54.336810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:54.338576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:54.339365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:54.339799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:54.505712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6070bd53-a2dc-40da-b951-872c8251a910 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.180309 Jan 05 18:11:54.506423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 330/696] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:54 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:55.518695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:55.519717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:55.526930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:55.527386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:55.528723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:55.529416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:55.642647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c529a60a-5902-4001-8b5c-ec89965156df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.127823 Jan 05 18:11:55.646685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 367/697] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:55 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:56.655235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:56.656228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:56.662521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:56.662969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:56.663769 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:56.664211 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:56.756698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-204b7209-6796-4154-9394-15a905d94696 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.105301 Jan 05 18:11:56.757429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 331/698] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:56 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:11:57.768886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:57.769882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:57.776470 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:57.776950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:57.777732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:57.778202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:57.962527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fe68cc59-4cb9-42d1-8483-1fd907101745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.197372 Jan 05 18:11:57.963236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 368/699] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:57 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:11:58.974422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:11:58.975818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:11:58.982437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:58.982880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:11:58.983637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:11:58.984068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:03.267760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cc2e5eb5-5343-4160-8a0a-d141d5fb44c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 4.297143 Jan 05 18:12:03.268539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 332/700] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:11:58 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 4299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:04.280769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:04.281765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:04.288175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:04.288632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:04.289406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:04.289843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:04.419989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2a5e85ae-eba5-4950-9b02-db3b4672d588 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.143729 Jan 05 18:12:04.424781 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 369/701] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:04 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:05.431859 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:05.432861 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:05.440102 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:05.440557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:05.441327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:05.441762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:05.540269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5c154ddb-bb18-47d8-8271-b66e910d097a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.112155 Jan 05 18:12:05.540954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 333/702] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:05 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:06.552078 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:06.553109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:06.559494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:06.559942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:06.561509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:06.562166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:06.729600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dad52cef-1500-448b-8fd9-c77b215a8832 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.181403 Jan 05 18:12:06.730287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 370/703] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:06 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:06.878966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:06.879659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:06.886003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:06.886484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:06.887251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:06.887703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:07.021138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:07.028996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-96800bc3-6452-488f-a186-bb4c16868b83 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1593 microversion: 2.1 time: 0.153955 Jan 05 18:12:07.030240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 334/704] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:06 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:07.742323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:07.743322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:07.750049 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:07.750506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:07.751433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:07.751846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:07.918466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-56273421-1bfe-4c8a-aa45-9d3383ae2029 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.180119 Jan 05 18:12:07.920227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 371/705] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:07 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:08.930750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:08.931665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:08.938075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:08.938529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:08.939298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:08.939729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:09.044822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-259ce304-372d-45c5-b122-a61d7307d6a0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.117053 Jan 05 18:12:09.050379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 335/706] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:08 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:09.063930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-94094602-0055-4d19-874d-55583c3f86d1 req-d3532b84-8a92-41fc-86a4-6c1aafe822a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:09.065893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:09.065893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:12:09.074363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-94094602-0055-4d19-874d-55583c3f86d1 req-d3532b84-8a92-41fc-86a4-6c1aafe822a7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:09.075124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-94094602-0055-4d19-874d-55583c3f86d1 req-d3532b84-8a92-41fc-86a4-6c1aafe822a7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:09.088477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-94094602-0055-4d19-874d-55583c3f86d1 req-d3532b84-8a92-41fc-86a4-6c1aafe822a7 service nova] Creating event network-changed:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:12:09.094543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-94094602-0055-4d19-874d-55583c3f86d1 req-d3532b84-8a92-41fc-86a4-6c1aafe822a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 Jan 05 18:12:09.095683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 372/707] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:12:09.428158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-493109343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84115276", "security_groups": [{"name": "tempest-secgroup-smoke-143875598"}], "block_device_mapping_v2": [{"uuid": "2364833e-d993-4884-b3fc-8cfd813e03f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f66398-92a1-4614-82f3-d4ba84635ba6"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:09.590276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] validate_networks() for [('f6f66398-92a1-4614-82f3-d4ba84635ba6', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:12:10.012239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:10.013088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:10.020838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.021370 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.022186 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.022611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.127063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lazy-loading 'services' on Instance uuid 67f02911-1ce0-4c13-9006-ac6f05ae4a45 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:12:10.381840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:12:10.382356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:12:10.382740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:12:10.383141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:12:10.383547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:12:10.393090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.395901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.395901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.395901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.410593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:12:10.414492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for user 15c202797c1440e1beb37e997904ac04 and project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:12:10.444891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-97764373-3b95-471c-b9c7-f6e2a44914bd tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45/os-volume_attachments/457e0b9f-fee8-4951-8141-c3483420d7db" status: 202 len: 0 microversion: 2.1 time: 0.436571 Jan 05 18:12:10.445852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 373/708] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:12:10 2022] DELETE /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45/os-volume_attachments/457e0b9f-fee8-4951-8141-c3483420d7db => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:10.453644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:10.455110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:10.462606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.463544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.464564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:10.465159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:10.515300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:12:10.517607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2364833e-d993-4884-b3fc-8cfd813e03f1',volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:12:10.581842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-52503299-2522-4c39-a2fa-88f0f1d5def5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.134732 Jan 05 18:12:10.582585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 374/709] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:10 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:10.840714 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-512e0ded-44d1-4786-b34a-bb44e7436e6a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.417494 Jan 05 18:12:10.841361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 336/710] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:12:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:12:10.852377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a84f545a-d6be-44c9-8e5c-7f143dff6d45 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:10.853077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a84f545a-d6be-44c9-8e5c-7f143dff6d45 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:10.916829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a84f545a-d6be-44c9-8e5c-7f143dff6d45 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:10.924422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a84f545a-d6be-44c9-8e5c-7f143dff6d45 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1092 microversion: 2.1 time: 0.076183 Jan 05 18:12:10.930147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 375/711] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:10 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:11.597666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:11.598749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:11.605630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:11.606180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:11.606957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:11.607956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:11.649901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-563225626"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:11.650676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:11.659689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:11.660128 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:11.660908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:11.661339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:11.700036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-be6afcac-315e-43c0-9d6c-1c5aa7d34867 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.106102 Jan 05 18:12:11.704044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 337/712] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:11 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:11.780767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.network.security_group_api [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Adding security group 9d582619-dee7-4eb3-8839-49d2ea43f8b4 to port ed059967-44ef-462e-a799-7ce65c5e7e04 Jan 05 18:12:11.940997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-26651cd7-7156-40f2-8c67-717a3eabc54c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:11.942037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-26651cd7-7156-40f2-8c67-717a3eabc54c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:11.997590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-26651cd7-7156-40f2-8c67-717a3eabc54c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:12.004165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-26651cd7-7156-40f2-8c67-717a3eabc54c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1092 microversion: 2.1 time: 0.067170 Jan 05 18:12:12.004723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 338/713] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:11 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:12.193314 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-56f2b8cd-f941-414e-b3f7-02d5585fd056 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action" status: 202 len: 0 microversion: 2.1 time: 0.547235 Jan 05 18:12:12.196694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 376/714] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:12:11 2022] POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:12.204121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:12.204745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:12.216091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:12.216545 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:12.218525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:12.220138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:12.378639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-8053db53-7de7-4a70-8b61-359c65cb4b8f req-fde19ff6-faed-4f99-a397-04184440ea35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:12.380292 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:12.380292 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:12:12.396540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8053db53-7de7-4a70-8b61-359c65cb4b8f req-fde19ff6-faed-4f99-a397-04184440ea35 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:12.397035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8053db53-7de7-4a70-8b61-359c65cb4b8f req-fde19ff6-faed-4f99-a397-04184440ea35 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:12.410929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-8053db53-7de7-4a70-8b61-359c65cb4b8f req-fde19ff6-faed-4f99-a397-04184440ea35 service nova] Creating event network-changed:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:12:12.416340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-8053db53-7de7-4a70-8b61-359c65cb4b8f req-fde19ff6-faed-4f99-a397-04184440ea35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216104 Jan 05 18:12:12.417535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 377/715] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:12:12.441493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:12.451094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-95789f2a-15c0-4c4f-a4ea-7afcd74c2358 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1758 microversion: 2.1 time: 0.251224 Jan 05 18:12:12.452045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 339/716] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:12 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1758 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:12.723765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:12.724898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:12.731639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:12.732915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:12.734477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:12.735067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:12.830430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-57708a6c-5aa7-4ba7-8772-c6ec75ddf055 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.110911 Jan 05 18:12:12.831807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 378/717] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:12 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:13.020456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:13.021172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:13.027588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:13.028070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:13.029165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:13.030416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:13.098196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:13.105605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-63b6ceda-e946-4325-acdf-44469c41b825 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1190 microversion: 2.1 time: 0.088827 Jan 05 18:12:13.106206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 340/718] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:13 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:13.843027 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:13.844232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:13.851621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:13.852316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:13.853162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:13.861064 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:13.957379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e613619-0927-4933-8c2a-cbf97a50db8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.119030 Jan 05 18:12:13.958042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 379/719] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:13 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:14.121755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:14.122653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:14.128687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.129061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.130002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.130550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.208509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:14.208509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-887c34c1-f3be-4494-bcd9-454d95423d91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1208 microversion: 2.1 time: 0.081653 Jan 05 18:12:14.208509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 341/720] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:14 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:14.559840 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f7b09233-c6a0-466b-b6b2-7af5d924eccc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:14.572512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7b09233-c6a0-466b-b6b2-7af5d924eccc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.572975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7b09233-c6a0-466b-b6b2-7af5d924eccc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.660890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f7b09233-c6a0-466b-b6b2-7af5d924eccc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Going to try to stop instance {{(pid=116428) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 05 18:12:14.867029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f7b09233-c6a0-466b-b6b2-7af5d924eccc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 202 len: 0 microversion: 2.1 time: 0.311383 Jan 05 18:12:14.868241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 380/721] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:12:14 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:14.876213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:14.877051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:14.885806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.886291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.887095 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.887589 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.970150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:14.971159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:14.977411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.979699 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:14.979699 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:14.979699 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.071107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-49f283fd-caf7-497e-a53f-4a961f2589ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.105660 Jan 05 18:12:15.075364 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 381/722] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:14 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:15.082650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:15.093918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4819baea-3668-461f-ad85-0ba25a031ed1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.217870 Jan 05 18:12:15.095311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 342/723] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:14 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:15.217208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:15.218806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:15.229091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:15.229552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.230397 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:15.230868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.363259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:15.371347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9400b8a8-00cf-4a20-b62e-8e6e3f93983d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1275 microversion: 2.1 time: 0.158242 Jan 05 18:12:15.372014 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 382/724] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:15 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:15.538338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-d756e5e6-b06a-49fd-8adf-d2b093eeb2d7 req-7060904e-b3b8-4fd4-96c6-ffe486cf5b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d49986c-47f7-4efe-ab72-3178533fa6e3", "tag": "864ddde1-36f6-4e8a-836a-ca791ef77d5f"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:15.540307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:15.540307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:12:15.547464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d756e5e6-b06a-49fd-8adf-d2b093eeb2d7 req-7060904e-b3b8-4fd4-96c6-ffe486cf5b81 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:15.548287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d756e5e6-b06a-49fd-8adf-d2b093eeb2d7 req-7060904e-b3b8-4fd4-96c6-ffe486cf5b81 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.560297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-d756e5e6-b06a-49fd-8adf-d2b093eeb2d7 req-7060904e-b3b8-4fd4-96c6-ffe486cf5b81 service nova] Creating event network-changed:864ddde1-36f6-4e8a-836a-ca791ef77d5f for instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 on hv-cinder-xena0 Jan 05 18:12:15.566081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-d756e5e6-b06a-49fd-8adf-d2b093eeb2d7 req-7060904e-b3b8-4fd4-96c6-ffe486cf5b81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170067 Jan 05 18:12:15.566688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 343/725] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:12:15.847071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:15.847569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:15.853784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:15.854286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.862753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:15.862753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:15.881445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:12:16.083891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:16.084975 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:16.091185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.091718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.093116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.093699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.174378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5ea56419-7167-489b-a424-e37666b82fc3 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 204 len: 0 microversion: 2.1 time: 0.330564 Jan 05 18:12:16.174983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 383/726] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:12:15 2022] DELETE /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:12:16.189682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:16.190409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:16.196371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.197034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.198272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.198272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.248544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5016fe7c-1249-4d27-bfd7-762e65036151 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.168350 Jan 05 18:12:16.250057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 344/727] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:16 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:16.257315 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:16.258253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:16.267851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.268487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.269737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.270272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.350540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:16.360357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e346a194-b370-4c31-9c25-0516ca538608 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.175004 Jan 05 18:12:16.361703 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 384/728] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:16 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:16.388885 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:16.390298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:16.396396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.396924 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.397816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:16.398478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:16.527138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:16.529401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:16.536626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c5a607f9-6c69-403c-b1d9-943582b24021 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1275 microversion: 2.1 time: 0.151242 Jan 05 18:12:16.537148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b1de9352-4ef4-40ac-bbce-07908053d915 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1514 microversion: 2.1 time: 0.285199 Jan 05 18:12:16.546281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 385/729] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:16 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:16.546479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 345/730] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:16 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:17.260767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:17.261652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:17.267753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.268210 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.268991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.269429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.363016 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d0b76c01-5ed5-46e4-b705-df031cb6e5c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.105938 Jan 05 18:12:17.364865 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 386/731] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:17 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:17.380723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:17.381328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:17.387703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.388170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.388932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.389419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.513158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:17.520935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9db89686-3f84-4072-b783-6a70ca9442fe tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.143920 Jan 05 18:12:17.525767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 346/732] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:17 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:17.554178 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:17.554815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:17.554947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:17.555237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:17.560824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.564446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.564590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.564590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.564779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.564779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.564950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:17.564950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:17.694581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:17.697773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:17.702591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b35f2255-ffbe-4bf3-9592-26033f42bb4f tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1514 microversion: 2.1 time: 0.151164 Jan 05 18:12:17.703166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 347/733] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:17 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:17.708531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e1b865b3-b453-4cc1-aa37-c39bfd897974 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.158203 Jan 05 18:12:17.709097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 387/734] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:17 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:18.374205 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:18.375167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:18.384832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.385340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.386286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.386798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.540237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:18.541142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:18.547198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.548227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.549227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.549607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.672777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:18.675728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0ecaa22f-f858-4f67-955b-84d08a2f5bd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.304979 Jan 05 18:12:18.679881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 348/735] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:18 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:18.681052 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bd1b8e40-b43b-4639-9141-d9afae42d1bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.144343 Jan 05 18:12:18.690473 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 388/736] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:18 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:18.720914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:18.721606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:18.726769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:18.727676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:18.728156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.728603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.729367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.729802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.734144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.734603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.735657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:18.735842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:18.859126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:18.867797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2b890cb9-470f-46ec-9a9c-74ebfdab1f77 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.146261 Jan 05 18:12:18.868398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 389/737] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:18 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:18.937566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:18.945406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c36f949e-23c9-406b-96c4-a6ed8e022233 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1514 microversion: 2.1 time: 0.229291 Jan 05 18:12:18.946093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 349/738] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:18 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:19.366788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-927daa32-2291-4197-aec7-5bb095abdbc1 req-d4ddea0a-6ce0-40ce-9735-f22b2fd818e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f02911-1ce0-4c13-9006-ac6f05ae4a45", "name": "network-vif-deleted", "tag": "5a020fa7-9166-4830-bf8c-76aadb9d4ebd"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:19.368501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:19.368501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:12:19.375298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-927daa32-2291-4197-aec7-5bb095abdbc1 req-d4ddea0a-6ce0-40ce-9735-f22b2fd818e9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.376374 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-927daa32-2291-4197-aec7-5bb095abdbc1 req-d4ddea0a-6ce0-40ce-9735-f22b2fd818e9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.387291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-927daa32-2291-4197-aec7-5bb095abdbc1 req-d4ddea0a-6ce0-40ce-9735-f22b2fd818e9 service nova] Creating event network-vif-deleted:5a020fa7-9166-4830-bf8c-76aadb9d4ebd for instance 67f02911-1ce0-4c13-9006-ac6f05ae4a45 on hv-cinder-xena0 Jan 05 18:12:19.393273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-927daa32-2291-4197-aec7-5bb095abdbc1 req-d4ddea0a-6ce0-40ce-9735-f22b2fd818e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Jan 05 18:12:19.394612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 390/739] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:12:19.691178 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:19.692235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:19.698323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:19.698746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.698980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.699141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:19.699809 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.700255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.705708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.706188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.707144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.707587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.797736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9c6e03d2-55e9-48db-b240-95fbbfa3977d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.110003 Jan 05 18:12:19.801794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 350/740] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:19 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:19.833710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:19.844454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8e57a5bd-4a06-428a-8efc-740f235f2bcf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.150053 Jan 05 18:12:19.845247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 391/741] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:19 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:19.884826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:19.885432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:19.892519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.893003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.896299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.896299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.963137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:19.963683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:19.971499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.971849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:19.972628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:19.973061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.005345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:20.005696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.005939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lazy-loading 'fault' on Instance uuid 67f02911-1ce0-4c13-9006-ac6f05ae4a45 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:12:20.027320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:20.035591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d6ea4452-2b34-4ae2-958b-6924571180b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.154788 Jan 05 18:12:20.036220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 351/742] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:19 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:20.048669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f5604b6125c4301aab55b63694331c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc13c6223d1445e0979009edce8585a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:20.056031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8fa717b6-89c9-40c7-8d53-9cd302e1bbe2 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 200 len: 1308 microversion: 2.1 time: 0.096595 Jan 05 18:12:20.057182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 392/743] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:19 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:20.808652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:20.809616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:20.816383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:20.816832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.817595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:20.818042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.862136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:20.862738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:20.868842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:20.869287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.870069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:20.870500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:20.909625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-88b6a0c1-1612-48ce-bfb1-d0bc5f89f9f6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.104540 Jan 05 18:12:20.911177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 352/744] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:20 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:20.993692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:21.002434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-056e408b-2683-4ebf-b34b-a6038e9a442e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.144313 Jan 05 18:12:21.003005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 393/745] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:20 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:21.055562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:21.056261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:21.062694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.063147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:21.064531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.065009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:21.074891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:21.075507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] [instance: 67f02911-1ce0-4c13-9006-ac6f05ae4a45] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:21.083456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.085005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:21.085805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.086340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:21.099880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] HTTP exception thrown: Instance 67f02911-1ce0-4c13-9006-ac6f05ae4a45 could not be found. Jan 05 18:12:21.100481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] Returning 404 to user: Instance 67f02911-1ce0-4c13-9006-ac6f05ae4a45 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:12:21.101565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1dea6555-9296-44e1-b4be-91c860fef2c8 tempest-VolumesSnapshotTestJSON-557263415 tempest-VolumesSnapshotTestJSON-557263415-project] 10.222.0.26 "GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45" status: 404 len: 111 microversion: 2.1 time: 0.030627 Jan 05 18:12:21.105264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 394/746] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:21 2022] GET /compute/v2.1/servers/67f02911-1ce0-4c13-9006-ac6f05ae4a45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:12:21.203156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:21.210914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-479e101b-ef10-43ba-85a5-55911ae95b8b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.159475 Jan 05 18:12:21.211832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 353/747] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:21 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:21.921229 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:21.922265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:21.928523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.928968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:21.929732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:21.930187 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:22.017885 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d397c0af-5721-4731-bec6-113dd1049f2b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.100308 Jan 05 18:12:22.018802 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 395/748] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:21 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:22.019698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:22.020310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:22.025960 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:22.026437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:22.027204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:22.027702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:22.147973 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:22.155712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-79ff9075-1b43-4da4-9b04-e6d7d15f063f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.139925 Jan 05 18:12:22.156284 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 354/749] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:22 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:22.228186 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:22.228907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:22.235995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:22.236459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:22.237240 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:22.237683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:22.359494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:22.366908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5134f5b2-7ec9-4b03-a859-743bf2514bd9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.142930 Jan 05 18:12:22.367698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 396/750] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:22 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:23.029116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:23.030045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:23.035974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.036436 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.037233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.037671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.125727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-76d8fdc9-56d0-42fa-9f63-2f95ad23fbdb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.100046 Jan 05 18:12:23.126403 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 355/751] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:23 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:23.173942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:23.174573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:23.180198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.180646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.181414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.181848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.300448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:23.308053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-819294d8-809f-49b1-b60e-f611eab77161 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.138211 Jan 05 18:12:23.308607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 397/752] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:23 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:23.384096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:23.384724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:23.391466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.391967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.392741 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:23.393172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:23.515659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:23.523278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-02da8d9c-2b43-4321-9ccd-55b66653f9b5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.143172 Jan 05 18:12:23.523897 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 356/753] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:23 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:24.137681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:24.138718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:24.145444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.145909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.146693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.147128 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.248185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6fa92815-9795-4199-b00e-f2559a5c5b02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.114123 Jan 05 18:12:24.248822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 398/754] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:24 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:24.325678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:24.326247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:24.332586 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.333036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.333846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.334308 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.452639 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:24.461207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3e3110e2-8e25-4b48-bb2b-bf309fb1df8a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.139345 Jan 05 18:12:24.461765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 357/755] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:24 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:24.540843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:24.541543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:24.548107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.548568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.549341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:24.549778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:24.668849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:24.676588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cc6d817c-8024-46e0-b1a2-70f51af77aab tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.139816 Jan 05 18:12:24.677149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 399/756] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:24 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:25.260277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:25.261189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:25.267455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.267899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.268665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.269102 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.478457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:25.479091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:25.484807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.485267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.486063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.486504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.605293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:25.613561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b990bd76-5fc9-4010-84f2-159d0d133b88 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.138991 Jan 05 18:12:25.614368 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 400/757] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:25 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:25.693129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:25.693730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:25.699759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.700204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.700977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:25.701401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:25.755260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f81cdc2b-32e4-4742-b18c-829e14ca99e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.498585 Jan 05 18:12:25.756801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 358/758] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:25 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:25.842042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:25.850295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e1a2b01-5d31-498a-b8c8-c717274e88e7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.160568 Jan 05 18:12:25.851118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 401/759] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:25 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:26.630718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:26.631411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:26.637996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.638472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.639237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.639667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.760455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:26.767991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:26.768850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d9cac2ec-9eb9-427e-95ae-855848b4de6b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.142085 Jan 05 18:12:26.768996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:26.769416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 359/760] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:26 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:26.774529 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.774970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.775732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.776163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.866732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:26.867340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:26.872969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.873450 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.874241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:26.874677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:26.996725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:27.004923 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f7577cb1-2947-4932-8ee6-344134709033 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.141688 Jan 05 18:12:27.005496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 360/761] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:26 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:27.786761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:27.787385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:27.793401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:27.793854 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:27.794710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:27.795121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:27.893948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-73d587f6-a3de-4070-831c-cd8b320f4bca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 1.130388 Jan 05 18:12:27.897783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 402/762] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:26 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:27.918984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:27.928230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a3f1fff3-9287-4da1-95ff-c433683a0751 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.145193 Jan 05 18:12:27.928230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 361/763] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:27 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:28.022484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:28.023189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:28.029418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.029867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:28.030663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.031101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:28.158591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:28.166935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3e8b99d2-97ad-4471-b87f-3fb69f1742d2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.148409 Jan 05 18:12:28.167493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 403/764] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:28 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:28.904387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:28.905304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:28.911180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.911628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:28.912397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.912835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:28.943743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:28.944376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:28.950086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.950558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:28.951327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:28.951780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:29.068456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:29.076055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-056eb875-cbd8-42e9-a3e2-12ce42ee46a9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.135910 Jan 05 18:12:29.076619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 404/765] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:28 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:29.184277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:29.184929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:29.191348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:29.191800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:29.192574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:29.193010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:29.309641 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:29.317271 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5ed92d8e-98bd-4953-a711-4ed93c1ca7e1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.136590 Jan 05 18:12:29.317835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 405/766] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:29 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:29.404959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1f1fb59c-791e-4d80-bf54-ee9685cf7711 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.503984 Jan 05 18:12:29.405604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 362/767] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:28 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:30.093600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:30.094305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:30.100190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.100628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.101629 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.102085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.233045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:30.242525 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fe27aac9-bece-4cd9-8a3e-9554fe8c2ca0 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1721 microversion: 2.1 time: 0.152413 Jan 05 18:12:30.243417 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 406/768] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:30 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:30.334217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:30.335231 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:30.341805 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.342277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.343243 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.343680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.417021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:30.418100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:30.424164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.424747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.425537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:30.425972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:30.468111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:30.475555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cbee2e49-8aa9-4877-abba-4f105dbd85b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.145355 Jan 05 18:12:30.476370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 363/769] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:30 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:30.512514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-63114837-158e-456f-9c2e-f327112eab27 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.099047 Jan 05 18:12:30.513151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 407/770] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:30 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:31.259585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:31.260199 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:31.266536 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.267175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.267939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.268381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.387140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:31.395338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9b625f48-3df0-4841-80e7-b4b99c7b7de7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1698 microversion: 2.1 time: 0.139407 Jan 05 18:12:31.399357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 364/771] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:31 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1698 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:31.416712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3fb73ee5-e480-483f-a47c-fb6650c47641 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:31.419764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fb73ee5-e480-483f-a47c-fb6650c47641 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.420207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fb73ee5-e480-483f-a47c-fb6650c47641 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.443532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3fb73ee5-e480-483f-a47c-fb6650c47641 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Going to try to start instance {{(pid=116428) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 05 18:12:31.492499 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:31.493063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:31.498786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.499249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.500026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.500542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.579623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3fb73ee5-e480-483f-a47c-fb6650c47641 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 202 len: 0 microversion: 2.1 time: 0.171111 Jan 05 18:12:31.581898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 408/772] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:12:31 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:31.586895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:31.587888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:31.594159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.594608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.595384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.595813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.691355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fdf7f3e5-5aca-45aa-b0e7-f6b5b97ca46b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.109717 Jan 05 18:12:31.695436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 409/773] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:31 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:31.697936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:31.699572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:31.707558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.708011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.708806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:31.709404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:31.841358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:31.849586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e38c86d0-e524-4291-a55b-cac28225a842 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1707 microversion: 2.1 time: 0.156152 Jan 05 18:12:31.850192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 410/774] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:31 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:31.874223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:31.879267 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bd189a76-e3bf-4bf2-a644-775cc127979d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.390581 Jan 05 18:12:31.880083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 365/775] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:31 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:32.283962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-8e04294f-fa84-475f-9649-23ec77027eb2 req-09854e04-2d5e-409b-a406-60d0290b09e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d49986c-47f7-4efe-ab72-3178533fa6e3", "name": "network-vif-plugged", "status": "completed", "tag": "864ddde1-36f6-4e8a-836a-ca791ef77d5f"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:32.285526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:32.285526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:12:32.292612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8e04294f-fa84-475f-9649-23ec77027eb2 req-09854e04-2d5e-409b-a406-60d0290b09e7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:32.293050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8e04294f-fa84-475f-9649-23ec77027eb2 req-09854e04-2d5e-409b-a406-60d0290b09e7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:32.304639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-8e04294f-fa84-475f-9649-23ec77027eb2 req-09854e04-2d5e-409b-a406-60d0290b09e7 service nova] Creating event network-vif-plugged:864ddde1-36f6-4e8a-836a-ca791ef77d5f for instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 on hv-cinder-xena0 Jan 05 18:12:32.309578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-8e04294f-fa84-475f-9649-23ec77027eb2 req-09854e04-2d5e-409b-a406-60d0290b09e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201809 Jan 05 18:12:32.310140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 411/776] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:12:32.702802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:32.703822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:32.709559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:32.710003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:32.710786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:32.711218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:32.867248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:32.867896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:32.873801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:32.874273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:32.875030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:32.875489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:32.993982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:33.001670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a9677b21-ba9a-4927-b318-e6aad454d60c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1707 microversion: 2.1 time: 0.138910 Jan 05 18:12:33.002283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 412/777] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:32 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1707 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:33.006682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:33.007270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:33.012766 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:33.013568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:33.013972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:33.014458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:33.134788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:33.142537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9eeb6dff-99e6-4b0e-86b3-1c20ea928bf3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.139244 Jan 05 18:12:33.143098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 413/778] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:33 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:33.414565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-353dd6cf-aedc-4f84-8156-6f54dd894465 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.715166 Jan 05 18:12:33.415134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 366/779] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:32 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:34.019696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:34.020305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:34.026112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.026585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.027354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.027791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.150867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:34.159749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:34.160263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-acb746d2-fdf7-4213-8b62-9320e7c1cc77 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1711 microversion: 2.1 time: 0.144586 Jan 05 18:12:34.160404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 414/780] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:34 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1711 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:34.160550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:34.166951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.167405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.168210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.168643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.291204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:34.298797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-05ef624c-5fef-49c9-b702-ac25654747a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1263 microversion: 2.1 time: 0.143156 Jan 05 18:12:34.299138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 367/781] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:34 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:34.426643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:34.427667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:34.433276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.433728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.434521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:34.434956 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:34.534735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ceb4fcd5-8fd9-491a-91ff-4b5ead97361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.112183 Jan 05 18:12:34.535726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 415/782] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:34 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:35.314644 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:35.315250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:35.321446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.321932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.322831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.323265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.446196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:35.454185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-01164132-da03-4de6-86fd-6929aedb17b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1450 microversion: 2.1 time: 0.142785 Jan 05 18:12:35.459956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 368/783] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:35 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:35.471543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:35.472240 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:35.479361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.479830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.480709 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.481145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.545403 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:35.546446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:35.552366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.552894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.553681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:35.554150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:35.605852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:35.613455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-222216ca-70fe-4450-bde6-f649ac84b2df tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1450 microversion: 2.1 time: 0.146440 Jan 05 18:12:35.614048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 416/784] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:35 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:35.642412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c1a00b50-e3ed-400f-9119-6345cf0038e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.100506 Jan 05 18:12:35.643281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 369/785] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:35 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:36.653899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:36.654746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:36.661714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:36.662195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:36.669667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:36.669667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:37.671585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-024754d0-7034-4067-962e-fb09d726d412 req-7b386be0-cbaa-41bf-8403-4df825807176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d49986c-47f7-4efe-ab72-3178533fa6e3", "tag": "864ddde1-36f6-4e8a-836a-ca791ef77d5f"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:37.673845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:37.673845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:12:37.681798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-024754d0-7034-4067-962e-fb09d726d412 req-7b386be0-cbaa-41bf-8403-4df825807176 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:37.682728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-024754d0-7034-4067-962e-fb09d726d412 req-7b386be0-cbaa-41bf-8403-4df825807176 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:37.697825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-024754d0-7034-4067-962e-fb09d726d412 req-7b386be0-cbaa-41bf-8403-4df825807176 service nova] Creating event network-changed:864ddde1-36f6-4e8a-836a-ca791ef77d5f for instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 on hv-cinder-xena0 Jan 05 18:12:37.702900 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-024754d0-7034-4067-962e-fb09d726d412 req-7b386be0-cbaa-41bf-8403-4df825807176 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035937 Jan 05 18:12:37.703534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 370/786] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:12:41.278209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-69f6f082-bf2e-4fbc-a239-996236c18802 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 4.627862 Jan 05 18:12:41.279050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 417/787] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:36 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 4629 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:42.290576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:42.291662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:42.298651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:42.299093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:42.299857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:42.300291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:42.400349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8b090f70-ecc7-4de1-9959-f1c9746d40fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.114198 Jan 05 18:12:42.400981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 371/788] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:42 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:43.413285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:43.414306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:43.420697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:43.421139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:43.422453 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:43.422917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:43.558711 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-654342ed-242d-4ab0-971d-4d44e40391e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.149306 Jan 05 18:12:43.559420 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 418/789] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:43 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:44.571035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-120560297", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "becddd08-ad76-4f90-a4a2-16d455ffba11"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:44.571581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:44.572139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:44.579216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:44.579661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:44.580448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:44.580862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:44.623382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] validate_networks() for [('becddd08-ad76-4f90-a4a2-16d455ffba11', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:12:44.675346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ddd7983e-0fd8-4420-afcd-1e3980463990 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28643 microversion: 2.20 time: 0.107989 Jan 05 18:12:44.679260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 419/790] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:44 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28643 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:44.958045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:12:44.958505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:12:44.958969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:12:44.959373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:12:44.959777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:12:44.968221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:44.968666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:44.969597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:44.970045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:44.987051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Getting quotas for project eff95feb5fbc4573ab2f22cb0b117a81. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:12:44.991036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Getting quotas for user 7fc7a64382b84d5fa655708cddb95084 and project eff95feb5fbc4573ab2f22cb0b117a81. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:12:45.002330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:12:45.004739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:12:45.126590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c3c8c400-69b9-4c9b-8794-d42f5cbdf065 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559500 Jan 05 18:12:45.127262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 372/791] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:12:45.137562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6b2a4c98-0110-491b-8f57-15353b1dffdc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:45.138291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6b2a4c98-0110-491b-8f57-15353b1dffdc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:45.196010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6b2a4c98-0110-491b-8f57-15353b1dffdc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:45.202499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6b2a4c98-0110-491b-8f57-15353b1dffdc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1213 microversion: 2.1 time: 0.069086 Jan 05 18:12:45.203081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 420/792] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:45 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:45.687608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:45.688983 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:45.695401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:45.695852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:45.696652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:45.697088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:45.815835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4effb615-d96f-415b-82a2-01eaaa82da37 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 28762 microversion: 2.20 time: 0.132321 Jan 05 18:12:45.820127 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 373/793] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:45 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 28762 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:46.219298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:46.220279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:46.228608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:46.229141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:46.230148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:46.230595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:46.291919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:46.299891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b418c3a5-ae98-40b7-afad-08c3a33cf701 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1217 microversion: 2.1 time: 0.084389 Jan 05 18:12:46.301940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 421/794] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:46 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:46.827999 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:46.829139 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:46.835503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:46.835946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:46.836708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:46.837135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:46.942106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-90eaf15e-90ef-41e9-a958-d7166e282734 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 30398 microversion: 2.20 time: 0.117947 Jan 05 18:12:46.947066 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 374/795] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:46 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 30398 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:47.318307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:47.319102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:47.326469 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:47.327097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:47.328166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:47.331206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:47.389060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:47.397710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fe3b6513-1fea-443b-89c0-134a82c020cd tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1273 microversion: 2.1 time: 0.083220 Jan 05 18:12:47.398784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 422/796] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:47 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:12:47.954234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:47.955273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:47.961847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:47.962391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:47.963278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:47.963713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:48.084537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aaca4f84-8d86-43c4-8794-a410b640cf62 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 31759 microversion: 2.20 time: 0.134316 Jan 05 18:12:48.085431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 375/797] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:47 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 31759 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:48.415427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:48.416056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:48.422252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:48.422699 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:48.423464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:48.423897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:48.541659 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:48.549336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4f4edee0-367c-423b-9c55-77e4aacf15d1 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.137561 Jan 05 18:12:48.549894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 423/798] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:48 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:49.051555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-f577ad6f-c56b-4b5e-83ec-0ee2bf2b7589 req-0e0a199e-d7bf-40c8-9bbe-4057d4181ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb", "tag": "40ca4814-41ba-4d1e-a5f5-df7259a6b2b9"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:49.053022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:49.053022 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:12:49.060937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f577ad6f-c56b-4b5e-83ec-0ee2bf2b7589 req-0e0a199e-d7bf-40c8-9bbe-4057d4181ef3 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:49.061385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f577ad6f-c56b-4b5e-83ec-0ee2bf2b7589 req-0e0a199e-d7bf-40c8-9bbe-4057d4181ef3 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:49.072349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-f577ad6f-c56b-4b5e-83ec-0ee2bf2b7589 req-0e0a199e-d7bf-40c8-9bbe-4057d4181ef3 service nova] Creating event network-changed:40ca4814-41ba-4d1e-a5f5-df7259a6b2b9 for instance 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb on hv-cinder-xena0 Jan 05 18:12:49.076932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-f577ad6f-c56b-4b5e-83ec-0ee2bf2b7589 req-0e0a199e-d7bf-40c8-9bbe-4057d4181ef3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030168 Jan 05 18:12:49.077532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 376/799] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:12:49.096838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:49.097801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:49.103954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:49.108376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:49.108376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:49.108376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:49.233512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-498c8edc-c2b0-4f9d-ad78-2fbda589fbc0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 33083 microversion: 2.20 time: 0.141093 Jan 05 18:12:49.234446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 424/800] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:49 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 33083 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:49.566982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:49.567685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:49.573641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:49.574122 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:49.574930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:49.575371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:49.728097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:49.735332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4d813968-f3d8-4251-bfd4-07422ae64fc9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.172304 Jan 05 18:12:49.735891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 377/801] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:49 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:50.246686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:50.247607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:50.254810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:50.255255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:50.256021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:50.256452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:50.687927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5564cda6-ffea-4f6f-aebc-8da6676c5b3d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 33854 microversion: 2.20 time: 0.445192 Jan 05 18:12:50.690208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 425/802] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:50 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 33854 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:50.751681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:50.752302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:50.759311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:50.759758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:50.760528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:50.760961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:50.881607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:50.888731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-273f1d5f-8697-405b-b1f1-92b21facddb8 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.141185 Jan 05 18:12:50.889298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 378/803] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:50 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:51.700308 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:51.701337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:51.708013 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:51.708464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:51.709234 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:51.709679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:51.843086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-03c83c6b-750a-4aca-96fb-ba74dbcae921 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 34955 microversion: 2.20 time: 0.139455 Jan 05 18:12:51.843086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 426/804] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:51 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 34955 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:51.905383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:51.905997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:51.911911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:51.912332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:51.913114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:51.913554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:52.034630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:52.041876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-963138a0-b363-4cb6-9e66-1bcfbf4c58dc tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.140117 Jan 05 18:12:52.042471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 379/805] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:51 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:52.848811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:52.849717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:52.856207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:52.856649 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:52.857405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:52.857847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:52.982249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e040cde-1642-42bd-ad0f-16b0290cc80b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 35728 microversion: 2.20 time: 0.137926 Jan 05 18:12:52.982901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 427/806] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:52 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 35728 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:12:53.058738 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:53.059405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:53.065690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:53.066189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:53.067019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:53.067461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:53.185393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:53.192610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-677e685f-e507-4acd-a489-378956e08457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.137681 Jan 05 18:12:53.193176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 380/807] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:53 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:53.995268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:53.996391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:54.003647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:54.004096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:54.004864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:54.005299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:54.107611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4538f6f2-4955-4a0b-94f1-40d7d9bcee7a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 37098 microversion: 2.20 time: 0.116019 Jan 05 18:12:54.113177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 428/808] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:53 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 37098 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:54.209698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:54.210903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:54.216796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:54.217282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:54.218081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:54.218521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:54.438372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:54.445668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-350d409f-bde9-4f30-b282-b2762b0e5f01 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.240265 Jan 05 18:12:54.446252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 381/809] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:54 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:55.120994 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:55.122118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:55.128963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:55.129411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:55.130231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:55.130670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:55.229142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-13ea9463-3333-4d84-af66-5faeaaabb27e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 38199 microversion: 2.20 time: 0.112210 Jan 05 18:12:55.229788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 429/810] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:55 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 38199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:55.462289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:55.462832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:55.468595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:55.469037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:55.469791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:55.470253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:55.592908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:55.600055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-965329d8-b837-42a0-bdb8-f8fe291c3cb4 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.141499 Jan 05 18:12:55.600612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 382/811] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:55 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:56.241440 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:56.242472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:56.249077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:56.249521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:56.250325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:56.250813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:56.345585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-73406c11-90ce-4f8c-8f8d-935c58d9fc32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 38199 microversion: 2.20 time: 0.107968 Jan 05 18:12:56.346949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 430/812] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:56 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 38199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:56.615929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:56.616437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:56.622434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:56.622926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:56.623703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:56.624148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:56.742441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:56.749442 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a58c0519-0a08-4278-9932-abe07de98620 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.137252 Jan 05 18:12:56.750009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 383/813] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:56 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:57.358310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:57.359345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:57.366432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:57.366871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:57.367632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:57.368058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:57.454673 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df0ebd0b-1d3b-483a-80b5-45f57d3a21dd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 38199 microversion: 2.20 time: 0.100760 Jan 05 18:12:57.455586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 431/814] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:57 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 38199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:57.766400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:57.767002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:57.773836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:57.774313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:57.775072 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:57.775507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:57.892331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:57.900233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f2ada7a3-b441-478d-890f-9b1586ddba55 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.137523 Jan 05 18:12:57.900790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 384/815] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:57 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:58.231522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-aee39b26-d400-4890-bdae-e1868c9e1b8d req-1ceb2d77-08ac-472a-95de-31339cee5acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb", "name": "network-vif-plugged", "status": "completed", "tag": "40ca4814-41ba-4d1e-a5f5-df7259a6b2b9"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:58.233017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:12:58.233017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:12:58.241181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-aee39b26-d400-4890-bdae-e1868c9e1b8d req-1ceb2d77-08ac-472a-95de-31339cee5acf service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:58.241618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-aee39b26-d400-4890-bdae-e1868c9e1b8d req-1ceb2d77-08ac-472a-95de-31339cee5acf service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:58.252978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-aee39b26-d400-4890-bdae-e1868c9e1b8d req-1ceb2d77-08ac-472a-95de-31339cee5acf service nova] Creating event network-vif-plugged:40ca4814-41ba-4d1e-a5f5-df7259a6b2b9 for instance 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb on hv-cinder-xena0 Jan 05 18:12:58.258619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-aee39b26-d400-4890-bdae-e1868c9e1b8d req-1ceb2d77-08ac-472a-95de-31339cee5acf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Jan 05 18:12:58.259194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 432/816] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:12:58.466376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:58.467212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:58.473045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:58.473525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:58.477812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:58.477812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:58.605401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-70ae7374-9f7e-44f1-a00b-c707c9f28e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 38199 microversion: 2.20 time: 0.142758 Jan 05 18:12:58.606057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 385/817] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:58 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 38199 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:58.917153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:58.917837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:58.923796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:58.924237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:58.925035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:58.925965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:59.044202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:12:59.051496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-046ae3e5-7427-4d24-a190-0db56947eed0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.138366 Jan 05 18:12:59.052055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 433/818] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:12:58 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:12:59.617729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:12:59.618753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:59.625220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:59.625667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:59.626467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:59.626903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:59.759510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d94ee25f-5dcf-4be6-8a4f-aa5c3a2a8d31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 200 len: 38342 microversion: 2.20 time: 0.145787 Jan 05 18:12:59.760149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 386/819] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:12:59 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 38342 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:12:59.770092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:12:59.770589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:12:59.776762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:59.777205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:59.777971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:12:59.778432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:12:59.800795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e73b20e6-f460-472c-882a-5ac4f7bb1c07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.033857 Jan 05 18:12:59.801339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 434/820] 10.222.0.26 () {60 vars in 1288 bytes} [Wed Jan 5 18:12:59 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:13:00.067851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:00.068599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:00.074958 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:00.075402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:00.076171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:00.076610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:00.202359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:00.209690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2e084bc1-029b-47a1-bd38-69f7e9a36e05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1313 microversion: 2.1 time: 0.146343 Jan 05 18:13:00.210282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 387/821] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:00 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:01.227859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:01.228458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:01.234238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:01.234703 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:01.235522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:01.235965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:01.358533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:01.366837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d8ad062f-6bea-481c-9b1d-c25fa08130b7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1497 microversion: 2.1 time: 0.142879 Jan 05 18:13:01.367677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 435/822] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:01 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:02.255150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:02.255751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:02.261948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:02.262427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:02.263365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:02.263800 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:02.287906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:13:02.541331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-383e605b-dd21-4721-a52d-b3ccfed037e5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 204 len: 0 microversion: 2.1 time: 0.290211 Jan 05 18:13:02.541932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 388/823] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:13:02 2022] DELETE /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:13:02.551517 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:02.552158 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:02.558548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:02.558992 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:02.559751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:02.560182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:02.716359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:02.716359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-93d77cf6-070e-4184-ad49-e0b75ff4da76 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1503 microversion: 2.1 time: 0.144705 Jan 05 18:13:02.716359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 436/824] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:02 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:03.509677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:03.510329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:03.516143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:03.516596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:03.517372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:03.517807 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:03.539848 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lazy-loading 'flavor' on Instance uuid 75a21fb6-f469-48ac-81fb-ed035fec00b8 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:13:03.709243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:03.709970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:03.717829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:03.718305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:03.719104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:03.719537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:03.840755 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:03.848828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7b091aa1-7b06-46b2-870d-8a7bc18af824 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1503 microversion: 2.1 time: 0.143661 Jan 05 18:13:03.849715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 437/825] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:03 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:13:04.107114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f366b911-0541-4729-a04b-e19e07025d28 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 202 len: 0 microversion: 2.20 time: 0.601305 Jan 05 18:13:04.107798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 389/826] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:13:03 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:13:04.116531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:04.117352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:04.122983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:04.123438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:04.124216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:04.124701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:04.249072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:04.257401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:04.258971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:04.260107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fd7f92d0-f6ea-49eb-a1e6-dac2d7e57ea5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.148035 Jan 05 18:13:04.260663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 438/827] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:04 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:04.867063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:04.867705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:04.873687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:04.879029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:04.879029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:04.879029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:05.068557 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:05.075695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-346cbeba-b8f2-44f6-8bb6-b5dbad6100f9 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1503 microversion: 2.1 time: 0.213380 Jan 05 18:13:05.076247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 390/828] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:04 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:13:05.279250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:05.279913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:05.286553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:05.287005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:05.287824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:05.288264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:05.309571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-497c3d45-6e54-4186-b666-09490e6f53ea req-6404dd1f-a6a2-4aed-a560-1ce87fcf34e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb", "name": "network-vif-deleted", "tag": "40ca4814-41ba-4d1e-a5f5-df7259a6b2b9"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:05.311272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:05.311272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:13:05.318901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-497c3d45-6e54-4186-b666-09490e6f53ea req-6404dd1f-a6a2-4aed-a560-1ce87fcf34e8 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:05.319620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-497c3d45-6e54-4186-b666-09490e6f53ea req-6404dd1f-a6a2-4aed-a560-1ce87fcf34e8 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:05.330336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-497c3d45-6e54-4186-b666-09490e6f53ea req-6404dd1f-a6a2-4aed-a560-1ce87fcf34e8 service nova] Creating event network-vif-deleted:40ca4814-41ba-4d1e-a5f5-df7259a6b2b9 for instance 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb on hv-cinder-xena0 Jan 05 18:13:05.335511 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-497c3d45-6e54-4186-b666-09490e6f53ea req-6404dd1f-a6a2-4aed-a560-1ce87fcf34e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029683 Jan 05 18:13:05.336105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 391/829] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:13:05.411328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:05.419077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:05.420540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:05.421668 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-731cf890-9778-47cf-a336-900fbd873c22 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.146164 Jan 05 18:13:05.422251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 439/830] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:05 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:06.092328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:06.093054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:06.100117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:06.100550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:06.101593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:06.102072 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:06.133208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:06.133667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:06.134139 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lazy-loading 'fault' on Instance uuid 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:13:06.174575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:06.181751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-af6fbb34-f977-4258-a2e4-72928f5eff05 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 200 len: 1303 microversion: 2.1 time: 0.093574 Jan 05 18:13:06.182353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 392/831] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:06 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:06.440833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:06.441567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:06.447622 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:06.448070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:06.448836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:06.449270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:06.567168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:06.574693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:06.576195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:06.577336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6107f8a3-f9f1-46b7-a382-806c31f76d21 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.140659 Jan 05 18:13:06.577890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 440/832] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:06 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:07.199221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:07.199832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:07.205622 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.206875 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.207650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.208083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.220694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] HTTP exception thrown: Instance 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb could not be found. Jan 05 18:13:07.221277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Returning 404 to user: Instance 0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:13:07.222331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-be1c3876-a63a-4e32-abc1-d84e8eedf1f7 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb" status: 404 len: 111 microversion: 2.1 time: 0.026760 Jan 05 18:13:07.222842 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 393/833] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:07 2022] GET /compute/v2.1/servers/0e79aae2-f4f8-4ab5-be50-ca5fc9403cdb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:13:07.316503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1745908185", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "becddd08-ad76-4f90-a4a2-16d455ffba11"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:07.366615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] validate_networks() for [('becddd08-ad76-4f90-a4a2-16d455ffba11', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:13:07.595340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:07.595946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:07.602749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.603194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.603957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.604407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.727867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:07.735567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:07.737119 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:07.738366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fac538e6-a970-459a-8d21-da18d4536ccc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.146677 Jan 05 18:13:07.739014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 394/834] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:07 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:07.788959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:13:07.789459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:13:07.789867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:13:07.790306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:13:07.790719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:13:07.799117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.799561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.800580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:07.801059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:07.817827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Getting quotas for project eff95feb5fbc4573ab2f22cb0b117a81. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:13:07.821635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Getting quotas for user 7fc7a64382b84d5fa655708cddb95084 and project eff95feb5fbc4573ab2f22cb0b117a81. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:13:07.832633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:13:07.834883 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:13:07.994287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c6270061-82df-45e6-8678-0f57be89c581 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682001 Jan 05 18:13:07.994887 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 441/835] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:13:08.005579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-11a6edfc-eec1-4977-8b0b-72d1c2670ef0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:08.006237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-11a6edfc-eec1-4977-8b0b-72d1c2670ef0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:08.056977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-11a6edfc-eec1-4977-8b0b-72d1c2670ef0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:08.063462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-11a6edfc-eec1-4977-8b0b-72d1c2670ef0 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1214 microversion: 2.1 time: 0.062629 Jan 05 18:13:08.064008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 395/836] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:07 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:08.764071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:08.764667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:08.771487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:08.771925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:08.772689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:08.773212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:08.898357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:08.905922 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:08.912051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:08.912051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9fedb150-8604-496a-bbdf-7204165ad612 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.148291 Jan 05 18:13:08.912051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 442/837] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:08 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:09.080444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:09.081594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:09.088265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:09.088719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:09.089500 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:09.089937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:09.148932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:09.156062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1daee865-7a78-4df6-b54b-87712a0b7d0f tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1210 microversion: 2.1 time: 0.079321 Jan 05 18:13:09.156627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 396/838] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:09 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:09.926904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:09.927508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:09.933190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:09.933638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:09.934445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:09.934875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:10.060409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:10.069213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:10.070728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:10.071896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9cc63350-8b3d-4719-b72a-a72af7fb0fa5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.148842 Jan 05 18:13:10.072450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 443/839] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:09 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:10.172303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:10.172937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:10.180037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:10.180420 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:10.181204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:10.181641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:10.261391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:10.269953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-07e6c676-ada9-4540-8c3e-fdffe84aa8e6 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1272 microversion: 2.1 time: 0.101019 Jan 05 18:13:10.270672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 397/840] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:10 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:11.089519 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:11.090170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:11.096067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:11.096542 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:11.097304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:11.097736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:11.218302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:11.227673 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:11.229172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:11.230512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-24f5aa5e-3a43-4d7f-a3ad-d9d19b8f7816 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.144823 Jan 05 18:13:11.231081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 444/841] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:11 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:11.287302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:11.288140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:11.293990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:11.294543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:11.295312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:11.295752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:11.506037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:11.513206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1c830cb6-25f2-4c63-90e8-4aef30678f1e tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.230149 Jan 05 18:13:11.513793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 398/842] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:11 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:11.691891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-62ea49f5-ef9c-41d7-a67f-06c98d05bde9 req-025a7f68-4798-4905-b2de-b745a08c7ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96676164-6cff-4992-a10c-e87555832a67", "tag": "3c11b15b-d9f0-4074-9174-99f8f49074ad"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:11.693818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:11.693818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:13:11.701239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-62ea49f5-ef9c-41d7-a67f-06c98d05bde9 req-025a7f68-4798-4905-b2de-b745a08c7ada service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:11.701765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-62ea49f5-ef9c-41d7-a67f-06c98d05bde9 req-025a7f68-4798-4905-b2de-b745a08c7ada service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:11.713452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-62ea49f5-ef9c-41d7-a67f-06c98d05bde9 req-025a7f68-4798-4905-b2de-b745a08c7ada service nova] Creating event network-changed:3c11b15b-d9f0-4074-9174-99f8f49074ad for instance 96676164-6cff-4992-a10c-e87555832a67 on hv-cinder-xena0 Jan 05 18:13:11.717954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-62ea49f5-ef9c-41d7-a67f-06c98d05bde9 req-025a7f68-4798-4905-b2de-b745a08c7ada service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030671 Jan 05 18:13:11.718577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 445/843] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:13:12.248412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:12.249007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:12.254882 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:12.255323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:12.256087 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:12.256509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:12.452469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:12.460389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:12.461860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:12.463050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e9cd51c3-8135-48b1-8505-2d4558a872ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.218358 Jan 05 18:13:12.463607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 399/844] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:12 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:12.530849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:12.531539 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:12.538132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:12.538580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:12.539366 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:12.539800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:12.662436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:12.669512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-92a310b4-052f-43b2-9f48-7fe7e62f089b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.142775 Jan 05 18:13:12.670208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 446/845] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:12 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:13.482190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:13.482802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:13.489156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:13.489601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:13.490400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:13.490837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:13.610309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:13.619429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:13.620929 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:13.622123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-29ac383f-316c-4deb-a92c-16f11360c814 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.143623 Jan 05 18:13:13.622687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 400/846] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:13 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:13.685694 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:13.686322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:13.692425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:13.692869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:13.693635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:13.694094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:13.811721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:13.819355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-02f09b91-004c-4e37-b240-c4a7d871554a tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.137301 Jan 05 18:13:13.819907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 447/847] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:13 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:14.640808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:14.641447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:14.647269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:14.647718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:14.648486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:14.648921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:14.770131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:14.777778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:14.779318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:14.780456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-549b07ee-486e-4b2a-b0a9-63b228dd1f20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.143384 Jan 05 18:13:14.781014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 401/848] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:14 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:14.835506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:14.836033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:14.842162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:14.842614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:14.843386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:14.843823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:14.961217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:14.968279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4188a2fb-47d2-4dad-b601-3b9d985bb266 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.136602 Jan 05 18:13:14.968853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 448/849] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:14 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:15.798790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:15.799913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:15.805838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:15.806476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:15.808432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:15.808432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:15.926097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:15.933595 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:15.935113 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:15.936260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-62d9fc4f-c70d-4694-a9bb-c44d4c19f85a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.141173 Jan 05 18:13:15.936820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 402/850] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:15 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:15.985258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:15.985971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:15.992083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:15.992530 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:15.993291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:15.993716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:16.116395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:16.123575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dc41e2d1-5dd8-419b-94a2-29c3e11f3486 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.141925 Jan 05 18:13:16.124135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 449/851] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:15 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:16.954079 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:16.954682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:16.960966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:16.961406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:16.962217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:16.962649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:17.077804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:17.085450 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:17.086965 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:17.088096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc710d1f-1630-47a6-a290-d9b8662247b9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.137707 Jan 05 18:13:17.088649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 403/852] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:16 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:17.140587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:17.141305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:17.147135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:17.147582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:17.148388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:17.148826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:17.271194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:17.278251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c9992f14-ab31-4fcb-841a-73d26ba33954 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.141458 Jan 05 18:13:17.278812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 450/853] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:17 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:18.105871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:18.106505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:18.113256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:18.113711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:18.114506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:18.114950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:18.238818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:18.246506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:18.248013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:18.249165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5cba85b0-a5dc-44f6-92a2-ef5523f04c32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.147021 Jan 05 18:13:18.249722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 404/854] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:18 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:18.295178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:18.295781 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:18.302382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:18.302836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:18.303828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:18.304072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:18.420451 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:18.428161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-27561fc5-a3b9-4361-9a57-6c873b03d151 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.136578 Jan 05 18:13:18.428722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 451/855] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:18 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:19.267418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:19.272327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:19.274323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:19.274781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:19.275550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:19.275986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:19.394659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:19.402192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:19.403689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:19.404840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7ff78ebf-85d7-41dd-9e08-aace234a8bd7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.141206 Jan 05 18:13:19.405397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 405/856] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:19 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:19.444654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:19.445258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:19.450954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:19.451406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:19.452168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:19.452606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:19.574973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:19.582911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-188b6be4-54ea-4540-a1a2-ebe61849e48b tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.141874 Jan 05 18:13:19.583472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 452/857] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:19 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:20.423454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:20.426171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:20.428011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-f2567708-4758-4577-be5f-dea708551c40 req-ee5e57b2-3722-4b17-8a59-31b26c06c044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96676164-6cff-4992-a10c-e87555832a67", "name": "network-vif-plugged", "status": "completed", "tag": "3c11b15b-d9f0-4074-9174-99f8f49074ad"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:20.429563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:20.429563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:13:20.432456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:20.432862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:20.433642 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:20.434273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:20.436635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-f2567708-4758-4577-be5f-dea708551c40 req-ee5e57b2-3722-4b17-8a59-31b26c06c044 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:20.437084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-f2567708-4758-4577-be5f-dea708551c40 req-ee5e57b2-3722-4b17-8a59-31b26c06c044 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:20.448634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-f2567708-4758-4577-be5f-dea708551c40 req-ee5e57b2-3722-4b17-8a59-31b26c06c044 service nova] Creating event network-vif-plugged:3c11b15b-d9f0-4074-9174-99f8f49074ad for instance 96676164-6cff-4992-a10c-e87555832a67 on hv-cinder-xena0 Jan 05 18:13:20.453483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-f2567708-4758-4577-be5f-dea708551c40 req-ee5e57b2-3722-4b17-8a59-31b26c06c044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030331 Jan 05 18:13:20.454298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 453/858] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:13:20.565704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:20.573364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:20.574971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:20.583267 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8a8ee159-51a7-40f9-a2ca-0a18f19c1b8f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.156502 Jan 05 18:13:20.583267 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 406/859] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:20 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:20.600260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:20.600969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:20.607244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:20.612548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:20.612548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:20.612548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:20.728952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:20.737585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c0c1204f-9311-45bc-bf7f-d6daf9726da5 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.141052 Jan 05 18:13:20.739353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 454/860] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:20 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:21.593954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:21.594582 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:21.600397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:21.600845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:21.601869 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:21.602335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:21.721053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:21.729187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:21.730811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:21.731977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b65f7045-77b8-4fba-9c4e-3c9d420eea5d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.141731 Jan 05 18:13:21.732553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 407/861] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:21 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:21.754574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:21.755175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:21.760990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:21.761470 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:21.762264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:21.762697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:21.881864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:21.888893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a5d9d09a-c133-47a4-97e9-2b3977ac4657 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.138648 Jan 05 18:13:21.889455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 455/862] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:21 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:22.750414 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:22.750946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:22.757241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:22.757691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:22.758513 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:22.758948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:22.876289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:22.884369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:22.885849 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:22.887004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3832aead-f3ee-4ed6-9d22-79596910361c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.140396 Jan 05 18:13:22.887563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 408/863] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:22 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:22.905268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:22.905875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:22.911770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:22.912222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:22.912990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:22.913424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:23.031574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:23.038718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2010a945-06a7-4b66-baec-5c31b9762529 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1314 microversion: 2.1 time: 0.136957 Jan 05 18:13:23.039278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 456/864] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:22 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:23.904976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:23.905519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:23.912032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:23.912486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:23.913263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:23.913699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:24.033359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:24.041563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:24.043094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:24.044246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cefdf035-2473-4a10-9958-4ae8437790b1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.143121 Jan 05 18:13:24.044810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 409/865] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:23 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:24.055232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:24.055833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:24.061461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:24.061902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:24.062762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:24.063194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:24.179847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:24.187142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e59cb2be-8043-4ce5-ab8c-6cbfaa474457 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1499 microversion: 2.1 time: 0.135530 Jan 05 18:13:24.187710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 457/866] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:24 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1499 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:24.353764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-9a92bfa9-1f3a-4991-950d-261e0d0446d7 req-fd011e29-3242-418e-a0c5-6bf91d8fb131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "name": "network-vif-plugged", "status": "completed", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:24.355299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:24.355299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:13:24.362488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-9a92bfa9-1f3a-4991-950d-261e0d0446d7 req-fd011e29-3242-418e-a0c5-6bf91d8fb131 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:24.367249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-9a92bfa9-1f3a-4991-950d-261e0d0446d7 req-fd011e29-3242-418e-a0c5-6bf91d8fb131 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:24.373845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-9a92bfa9-1f3a-4991-950d-261e0d0446d7 req-fd011e29-3242-418e-a0c5-6bf91d8fb131 service nova] Creating event network-vif-plugged:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:13:24.379493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-9a92bfa9-1f3a-4991-950d-261e0d0446d7 req-fd011e29-3242-418e-a0c5-6bf91d8fb131 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029506 Jan 05 18:13:24.380128 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 410/867] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:13:25.061678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:25.062365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:25.068132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.068589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.069396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.069838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.108667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:25.109256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:25.119745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.120281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.121134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.121645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.146780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:13:25.192881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:25.200528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:25.201996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:25.203156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8b08f132-b88f-4a19-93bf-c1d129c3d731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.145140 Jan 05 18:13:25.203718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 458/868] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:25 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:25.415181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a0168dcf-89f2-4ba9-93b7-bfe2a819da03 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 204 len: 0 microversion: 2.1 time: 0.310160 Jan 05 18:13:25.415778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 411/869] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:13:25 2022] DELETE /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:13:25.423822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:25.424516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:25.430770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.431212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.431970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:25.432400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:25.557189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:25.564497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-83255af4-ddb9-4a5a-9e0f-f1d06541ba0d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1505 microversion: 2.1 time: 0.144387 Jan 05 18:13:25.565062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 459/870] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:25 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1505 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:26.221017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:26.221740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:26.228034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:26.228478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:26.229246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:26.229682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:26.348895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:26.356689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:26.358198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:26.359343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-77df4cd4-e453-484e-9ba4-9d51bb536ca7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.142456 Jan 05 18:13:26.359893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 412/871] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:26 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:26.581714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:26.582272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:26.587984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:26.588426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:26.589204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:26.589635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:26.706139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:26.713167 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3fa4f060-f0d1-4ce4-9dba-203915c97a20 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1505 microversion: 2.1 time: 0.135189 Jan 05 18:13:26.713733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 460/872] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:26 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1505 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:27.378413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:27.379017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:27.384703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:27.385152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:27.385899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:27.386368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:27.502349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:27.510445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:27.512009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:27.513147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9df9ca48-bfb7-4526-9529-80a7e8223d73 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.139153 Jan 05 18:13:27.513691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 413/873] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:27 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:13:27.730365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:27.730975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:27.736715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:27.737787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:27.738573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:27.739002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:27.857244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:27.865190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0c433295-c3a2-4717-b223-c091637dd749 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1505 microversion: 2.1 time: 0.138741 Jan 05 18:13:27.865770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 461/874] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:27 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1505 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:28.345324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-e584722a-b010-495b-b996-6ad407121b35 req-d3f7b110-2e17-463f-a858-d8fae93f9cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96676164-6cff-4992-a10c-e87555832a67", "name": "network-vif-deleted", "tag": "3c11b15b-d9f0-4074-9174-99f8f49074ad"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:28.347827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:28.347827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:13:28.354672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-e584722a-b010-495b-b996-6ad407121b35 req-d3f7b110-2e17-463f-a858-d8fae93f9cdc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.355109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-e584722a-b010-495b-b996-6ad407121b35 req-d3f7b110-2e17-463f-a858-d8fae93f9cdc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.365704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-e584722a-b010-495b-b996-6ad407121b35 req-d3f7b110-2e17-463f-a858-d8fae93f9cdc service nova] Creating event network-vif-deleted:3c11b15b-d9f0-4074-9174-99f8f49074ad for instance 96676164-6cff-4992-a10c-e87555832a67 on hv-cinder-xena0 Jan 05 18:13:28.370485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-e584722a-b010-495b-b996-6ad407121b35 req-d3f7b110-2e17-463f-a858-d8fae93f9cdc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 Jan 05 18:13:28.371057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 414/875] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:13:28.530804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:28.531434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:28.538037 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.538498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.539455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.539695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.662899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:28.670689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:28.672173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:28.673317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-41c3d464-6a4a-44e6-a854-782283edaa43 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.146275 Jan 05 18:13:28.673883 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 462/876] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:28 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:28.883314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:28.883934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:28.890142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.890593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.891355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.891791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.923274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:28.923708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:28.924148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lazy-loading 'fault' on Instance uuid 96676164-6cff-4992-a10c-e87555832a67 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:13:28.963986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc7a64382b84d5fa655708cddb95084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eff95feb5fbc4573ab2f22cb0b117a81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:28.971137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eb00fecf-3a8c-479c-9fb5-085b76e916b3 tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 200 len: 1304 microversion: 2.1 time: 0.091964 Jan 05 18:13:28.972213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 415/877] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:28 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:13:29.691835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:29.692511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:29.698432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:29.698890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:29.699650 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:29.700087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:29.818921 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:29.826466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:29.827947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:29.829085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-082507f5-be91-4ab6-86b1-f4f631ef6fef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.141250 Jan 05 18:13:29.829643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 463/878] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:29 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:29.987821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:29.988472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] [instance: 96676164-6cff-4992-a10c-e87555832a67] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:29.994173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:29.994713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:29.995537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:29.995967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:30.010107 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] HTTP exception thrown: Instance 96676164-6cff-4992-a10c-e87555832a67 could not be found. Jan 05 18:13:30.010688 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] Returning 404 to user: Instance 96676164-6cff-4992-a10c-e87555832a67 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:13:30.011498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c581d92f-e95a-4d4c-b7c2-754aa3a7843d tempest-VolumesActionsTest-1467410372 tempest-VolumesActionsTest-1467410372-project] 10.222.0.26 "GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67" status: 404 len: 111 microversion: 2.1 time: 0.027384 Jan 05 18:13:30.012019 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 416/879] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:13:29 2022] GET /compute/v2.1/servers/96676164-6cff-4992-a10c-e87555832a67 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:13:30.846946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:30.847691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:30.854254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:30.854704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:30.855468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:30.855900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:30.977900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:30.985502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:30.987718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:30.988865 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2b10c593-ae1c-47c9-aecc-6650948e9682 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1744 microversion: 2.20 time: 0.146186 Jan 05 18:13:30.989428 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 464/880] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:30 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:32.007576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:32.008849 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:32.016477 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:32.017007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:32.017875 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:32.018447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:32.152494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:32.161144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:32.162711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:32.163870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-296f9ae7-337f-4d0e-b19e-36d9eab44f84 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.161073 Jan 05 18:13:32.164427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 417/881] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:32 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:33.183664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:33.184921 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:33.191319 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:33.191786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:33.192742 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:33.193174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:33.323601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:33.333036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:33.334593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:33.335762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-507c11a0-2ebc-4dfd-aadf-8980e64ebe77 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.156750 Jan 05 18:13:33.336408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 465/882] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:33 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:34.354530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:34.355959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:34.363234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:34.363669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:34.364441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:34.365077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:34.501970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:34.514139 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:34.515780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:34.516924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-27a2ea08-764e-4c87-8bbc-fd995b4b9770 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.166346 Jan 05 18:13:34.517461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 418/883] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:34 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:35.539804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:35.540651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:35.547751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:35.548299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:35.549254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:35.550145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:35.700849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:35.709486 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:35.711043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:35.712238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-28ec9860-583f-4177-b43b-1bf5ebda1366 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.176350 Jan 05 18:13:35.712794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 466/884] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:35 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:36.730919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:36.732164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:36.739127 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:36.739850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:36.740845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:36.741285 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:36.880132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:36.888383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:36.889879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:36.891313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-47d77f22-fdec-4ec8-aaba-2c27235c4266 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.164082 Jan 05 18:13:36.891881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 419/885] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:36 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:37.911211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:37.912720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:37.918952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:37.919482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:37.920481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:37.921124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:38.078799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:38.090054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:38.092138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:38.093483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-86182c19-aa69-43cc-97a5-8ca5bfc761bd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.186697 Jan 05 18:13:38.094251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 467/886] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:37 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:39.112789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:39.113610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:39.127775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:39.128630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:39.130939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:39.131387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:39.321251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:39.331106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:39.333081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:39.334660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5edfd59c-7415-4e02-beab-eeff8b6d82aa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.226261 Jan 05 18:13:39.335512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 420/887] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:39 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:40.365975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:40.366712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:40.375952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:40.376744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:40.379192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:40.379192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:40.565161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:40.576687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:40.578620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:40.579774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-46bcf530-bb28-40cf-b087-2c93d139aa52 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.217772 Jan 05 18:13:40.590361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 468/888] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:40 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:41.599755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:41.600457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:41.607034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:41.607708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:41.608560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:41.609064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:41.801665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:41.810123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:41.817699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:41.819035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1e9a95b7-dc98-4424-9ef1-8c2d352b80ae tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.223773 Jan 05 18:13:41.819930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 421/889] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:41 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:42.839721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:42.840744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:42.847913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:42.848492 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:42.849370 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:42.849881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:43.045315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:43.055457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:43.057165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:43.058820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d1133729-b03c-4f45-9817-9824107fdd6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.224675 Jan 05 18:13:43.060136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 469/890] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:42 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:44.078467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:44.079201 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:44.086359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:44.086818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:44.087584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:44.088055 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:44.238570 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:44.246555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:44.248339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:44.249193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2aba7b82-f74d-4776-9883-53c2c8d4d683 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1739 microversion: 2.20 time: 0.175018 Jan 05 18:13:44.249745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 422/891] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:44 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:45.268262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:45.269106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:45.275165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:45.277654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:45.277654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:45.277654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:45.432879 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:45.441568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:45.443083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:45.444275 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-59ce9b45-ebfb-4ea2-bf6a-cd4a3301bb14 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1721 microversion: 2.20 time: 0.179837 Jan 05 18:13:45.444838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 470/892] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:45 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:46.429578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-ee4efad9-5607-47be-a60d-929bc34309ab req-5850e271-1439-484b-92fb-e4af5a3bf3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "name": "network-vif-unplugged", "status": "completed", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:46.431162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:13:46.431162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:13:46.444498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-ee4efad9-5607-47be-a60d-929bc34309ab req-5850e271-1439-484b-92fb-e4af5a3bf3ea service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:46.445260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-ee4efad9-5607-47be-a60d-929bc34309ab req-5850e271-1439-484b-92fb-e4af5a3bf3ea service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:46.457896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-ee4efad9-5607-47be-a60d-929bc34309ab req-5850e271-1439-484b-92fb-e4af5a3bf3ea service nova] Creating event network-vif-unplugged:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:13:46.464778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-ee4efad9-5607-47be-a60d-929bc34309ab req-5850e271-1439-484b-92fb-e4af5a3bf3ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038646 Jan 05 18:13:46.465453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 423/893] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:13:46.467083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:46.467893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:46.474796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:46.481958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:46.481958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:46.481958 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:46.629681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:46.640932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:46.642633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:46.644033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0c7a3cf7-341f-4a82-8ce6-bc6dd443c09e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1721 microversion: 2.20 time: 0.182003 Jan 05 18:13:46.645030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 471/894] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:46 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:47.800028 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:13:47.807777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:13:47.851205 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:47.852482 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:47.875790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:47.875790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:47.875790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:47.875790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:48.049653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:48.064182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:48.066842 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:48.068297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-594d43fb-7413-42ed-9f46-3f07236320e2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1724 microversion: 2.20 time: 0.409415 Jan 05 18:13:48.069393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 424/895] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:47 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:48.088237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e91302c-8061-475a-b9e2-82445bdac491"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:48.089266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:48.097137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:48.097680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:48.098534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:48.099141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:49.100479 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-aef4059b-ff7a-43a5-b4ea-08a36655c2cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.016067 Jan 05 18:13:49.101126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 472/896] 10.222.0.26 () {62 vars in 1363 bytes} [Wed Jan 5 18:13:48 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments => generated 188 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:13:49.237947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:13:49.238555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:49.244327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:49.244774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:49.245565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:49.246004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:49.483023 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c51cb75a-dbd6-4b00-bde2-8a956f79c212 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action" status: 202 len: 0 microversion: 2.20 time: 0.249489 Jan 05 18:13:49.487532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 425/897] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:13:49 2022] POST /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:13:49.492854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:49.493471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:49.501053 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:49.502320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:49.503614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:49.504383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:49.673535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:49.687997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:49.690393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:49.691833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-67015000-5fef-42ca-acca-ea4d6587acc9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1750 microversion: 2.20 time: 0.202883 Jan 05 18:13:49.692561 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 473/898] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:49 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:50.711616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:50.713048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:50.720011 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:50.720976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:50.722247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:50.723003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:50.854000 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:50.863867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:50.871415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:50.871415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-dbde4212-f554-489f-8ed3-f7ddff26f2e9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1750 microversion: 2.20 time: 0.159813 Jan 05 18:13:50.871415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 426/899] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:50 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:51.913447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:51.913447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:51.913447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:51.913447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:51.914655 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:51.914655 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:52.044167 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:52.053743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:52.055270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:52.056450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-eba4638a-de1f-4031-a240-9cd48fc97181 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1752 microversion: 2.20 time: 0.173259 Jan 05 18:13:52.057024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 474/900] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:51 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:53.076305 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:53.076917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:53.083831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:53.084300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:53.085084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:53.085519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:53.212708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:53.221993 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:53.223543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:53.224692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b8c765e8-d9dd-468a-96dd-e8ec196691b2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.152081 Jan 05 18:13:53.225242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 427/901] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:53 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:54.242983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:54.243591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:54.249394 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:54.249702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:54.250491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:54.250925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:54.384310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:54.397602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:54.399128 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:54.400285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e6c6e9d1-d55e-451e-bc1f-f35e45c62186 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.160872 Jan 05 18:13:54.402183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 475/902] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:54 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:55.419568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:55.420476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:55.427401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:55.428049 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:55.429094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:55.429745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:55.563801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:55.572291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:55.573962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:55.575432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aafc0059-54d1-4d1f-b7c7-6fba91d8a667 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.159849 Jan 05 18:13:55.576212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 428/903] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:55 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:13:56.594952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:56.595704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:56.602272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:56.602726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:56.603512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:56.603952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:56.727214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:56.735235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:56.737343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:56.738528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-353c63a5-98df-4a74-bb36-76b9865aaa33 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.147511 Jan 05 18:13:56.739089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 476/904] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:56 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:13:57.757194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:57.757798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:57.763699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:57.764175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:57.764936 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:57.765370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:57.892417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:57.901180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:57.902711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:57.903877 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4eb482e1-ae30-4669-b899-b232bdd59d32 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.151028 Jan 05 18:13:57.904445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 429/905] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:57 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:13:58.922797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:13:58.923509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:13:58.929784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:58.930263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:58.931056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:13:58.931485 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:13:59.081265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:59.090763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:59.095618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:13:59.095618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-562f48d5-b124-43e4-a68c-c9cb7d38a8e8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.174419 Jan 05 18:13:59.095618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 477/906] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:13:58 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:00.113618 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:00.114300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:00.120140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:00.120584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:00.121343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:00.121792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:00.298627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:00.298627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:00.298898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:00.300632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e47b63a4-777e-4397-815a-ee4815d45fe2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.191540 Jan 05 18:14:00.301413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 430/907] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:00 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:14:01.325505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:01.326911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:01.340310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:01.340944 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:01.341733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:01.343814 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:01.487513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:01.496385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:01.497847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:01.499317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-949c5703-2978-45ed-9299-525e77206780 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.184324 Jan 05 18:14:01.499746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 478/908] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:01 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:02.516362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:02.517039 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:02.523476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:02.523927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:02.524693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:02.525128 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:02.662988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:02.671703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:02.673206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:02.674394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3bf066fb-45db-4bf9-9c66-02974cfec306 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.161814 Jan 05 18:14:02.674955 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 431/909] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:02 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:03.695144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:03.701332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:03.702328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:03.703284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:03.704280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:03.704874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:03.742718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-21601698", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:03.833748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] validate_networks() for None {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:14:03.868721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:03.876863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:03.878375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:03.880081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e16e3027-8db1-433e-9e75-7c11c64c0735 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.190259 Jan 05 18:14:03.880636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 479/910] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:03 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:04.120804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:14:04.121245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:14:04.121718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:14:04.122165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:14:04.122575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:14:04.132491 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.132935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.133740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.134373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.151111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Getting quotas for project 9d66495117824c448493fd9b5c76a2dd. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:14:04.154985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Getting quotas for user 316f68eb203c4aafb270fa4c7851aba1 and project 9d66495117824c448493fd9b5c76a2dd. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:14:04.167107 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:14:04.170627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:14:04.184913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:04.188217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:04.198317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.204774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.204774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.204774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.296260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7d92dbd5-884a-4687-b702-5f27597ab47c tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558650 Jan 05 18:14:04.297141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 432/911] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 05 18:14:04.307256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-93b544ee-1682-4aac-ac8f-96595f95a97a tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:04.307878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-93b544ee-1682-4aac-ac8f-96595f95a97a tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:04.371568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-93b544ee-1682-4aac-ac8f-96595f95a97a tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:04.378053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-93b544ee-1682-4aac-ac8f-96595f95a97a tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1213 microversion: 2.1 time: 0.074877 Jan 05 18:14:04.378707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 433/912] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:04 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:04.401737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-10217f7e-f3b4-4374-82fe-ea90989435d5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action" status: 202 len: 0 microversion: 2.1 time: 0.222394 Jan 05 18:14:04.406344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 480/913] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:14:04 2022] POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:14:04.411996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:04.412783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:04.418830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.419311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.420081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.420513 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.551548 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:04.560107 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a3ee15ec-f595-4f17-843b-c315c4d2d089 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.152442 Jan 05 18:14:04.565136 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 434/914] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:04 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:04.899387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:04.900033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:04.906004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.906483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:04.907280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:04.907715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:05.040710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:05.056332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:05.058740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:05.059035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1092ba2f-6ba9-497d-99ac-8f60a8225127 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.164722 Jan 05 18:14:05.059712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 481/915] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:04 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:05.395146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-262ef4fc-81ca-4c6d-bf86-df9c1a74cc11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:05.395827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-262ef4fc-81ca-4c6d-bf86-df9c1a74cc11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:05.451690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-262ef4fc-81ca-4c6d-bf86-df9c1a74cc11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:05.458580 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-262ef4fc-81ca-4c6d-bf86-df9c1a74cc11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1213 microversion: 2.1 time: 0.067168 Jan 05 18:14:05.459153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 435/916] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:05 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:05.579743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:05.580386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:05.587097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:05.587537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:05.588293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:05.588721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:05.721513 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:05.730407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e45f079-b28b-4cb3-a72a-1be18b09f0d4 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.154394 Jan 05 18:14:05.731174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 482/917] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:05 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:06.077426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:06.078058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:06.084292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.084742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.085507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.085944 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.218938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:06.228368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:06.229999 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:06.231268 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-105fa613-4362-476a-8c7f-f09e5de7afd8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.157567 Jan 05 18:14:06.240280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 436/918] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:06 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:06.476034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:06.476642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:06.482715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.483156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.483907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.484342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.542785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:06.549758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f9052411-fdb7-406c-8ef5-ff5dbb849958 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1217 microversion: 2.1 time: 0.078285 Jan 05 18:14:06.550422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 483/919] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:06 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:06.746894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:06.747445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:06.753265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.753708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.754501 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:06.754930 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:06.874822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:06.883311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a62aea36-d088-4cc9-9e53-c65b4357165f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.140205 Jan 05 18:14:06.883873 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 437/920] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:06 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:07.250045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:07.250667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:07.257069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.257517 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:07.258317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.258766 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:07.379175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:07.387894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:07.389380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:07.390588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7220355e-2c97-4af8-b4d7-873ac40b6d0f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.144397 Jan 05 18:14:07.391150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 484/921] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:07 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:07.566323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:07.566913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:07.572636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.573087 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:07.573855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.574316 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:07.634808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:07.642004 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c4b0f381-194d-4187-a40f-73bc5db443d7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1217 microversion: 2.1 time: 0.079409 Jan 05 18:14:07.642583 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 438/922] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:07 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:07.900563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:07.901088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:07.906807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.907248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:07.908003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:07.908433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:08.025634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:08.033141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e3518291-1f9a-4f67-ad6b-fcd012808480 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.136308 Jan 05 18:14:08.033697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 485/923] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:07 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:08.408389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:08.409103 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:08.414832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:08.417233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:08.417233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:08.417233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:08.534366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:08.542521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:08.544166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:08.545302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-07903eed-0922-46bc-8ab9-bf25bc14c29b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.140655 Jan 05 18:14:08.545855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 439/924] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:08 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:08.658403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:08.659004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:08.664777 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:08.665217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:08.665969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:08.666424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:08.724283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:08.732176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7c715824-9dee-47a2-8eb5-6f700977738e tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1217 microversion: 2.1 time: 0.077439 Jan 05 18:14:08.732723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 486/925] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:08 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:09.050267 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:09.050872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:09.056702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.057143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.057928 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.058488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.176272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:09.183885 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a79c45ef-9d19-4edb-9104-fa7be0669001 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.137302 Jan 05 18:14:09.184448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 440/926] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:09 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:09.563153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:09.563880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:09.570041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.570505 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.571269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.571704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.693888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:09.701993 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:09.703497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:09.704644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-731e5d77-1cfb-4dfa-bad8-a84db17b1b65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.145335 Jan 05 18:14:09.705223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 487/927] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:09 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:09.748387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:09.748998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:09.755473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.755912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.756678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:09.757114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:09.815421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:09.823540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d99992b0-2876-4438-88f5-5676fadf2278 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1217 microversion: 2.1 time: 0.078844 Jan 05 18:14:09.824109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 441/928] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:09 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:10.200819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:10.201436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:10.207177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.207969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.208750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.209189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.334641 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:10.342276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-95b62170-e502-47c4-bbc8-34e1d5fea764 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.145044 Jan 05 18:14:10.342826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 488/929] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:10 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:10.723612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:10.724773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:10.730406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.730850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.731613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.732043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.840389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:10.841021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:10.847088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.847536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.848829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:10.849257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:10.913627 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:10.921139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c2372b1c-4efb-40b0-92d2-254269d4014f tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1265 microversion: 2.1 time: 0.084597 Jan 05 18:14:10.921907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 489/930] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:10 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:11.115072 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:11.123036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:11.124527 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:11.125656 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7fe1cd72-3f49-4c7c-85fd-9634a20214f5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.406247 Jan 05 18:14:11.126246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 442/931] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:10 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:11.359272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:11.360017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:11.365723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:11.366355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:11.367198 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:11.367697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:11.505093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:11.513096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a181fea6-6d1a-4c7e-a6b0-f7102963e3f3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1750 microversion: 2.1 time: 0.157536 Jan 05 18:14:11.514221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 490/932] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:11 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:11.938313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:11.938915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:11.945658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:11.946135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:11.946902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:11.947335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:12.023264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:12.030295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7523a4a5-2d47-4f07-a989-65078c9852da tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1271 microversion: 2.1 time: 0.095571 Jan 05 18:14:12.030856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 443/933] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:11 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:12.143170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:12.143749 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:12.149683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:12.150160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:12.150982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:12.151427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:12.274069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:12.279758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:12.281295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:12.282545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6ab7aa1d-3ea4-499e-9305-015dd4f81ddd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.143114 Jan 05 18:14:12.283107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 491/934] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:12 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:12.530827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:12.532179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:12.538835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:12.539286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:12.540071 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:12.540537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:12.782623 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:12.791159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5321b16f-8080-4af1-9fe7-ec38a6958061 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.264121 Jan 05 18:14:12.791741 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 444/935] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:12 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:13.047557 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:13.048437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:13.055111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.055938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.057277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.057873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.182582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:13.189966 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-818555de-a0ed-4c46-9406-c1688cc7ba11 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.146027 Jan 05 18:14:13.190595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 492/936] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:13 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:13.249841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-ce1c16e5-da0c-479f-bc6d-4bcdde314f4f req-b66516b7-410a-477a-a5f2-246fd12dfe0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e9ff186-8758-4b73-bc3d-0ebe16227f8c", "tag": "d0fa3b99-2186-40ac-a16e-0d7f9e869c83"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:13.251519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:14:13.251519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:14:13.258654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-ce1c16e5-da0c-479f-bc6d-4bcdde314f4f req-b66516b7-410a-477a-a5f2-246fd12dfe0f service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.259094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-ce1c16e5-da0c-479f-bc6d-4bcdde314f4f req-b66516b7-410a-477a-a5f2-246fd12dfe0f service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.273044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-ce1c16e5-da0c-479f-bc6d-4bcdde314f4f req-b66516b7-410a-477a-a5f2-246fd12dfe0f service nova] Creating event network-changed:d0fa3b99-2186-40ac-a16e-0d7f9e869c83 for instance 0e9ff186-8758-4b73-bc3d-0ebe16227f8c on hv-cinder-xena0 Jan 05 18:14:13.278607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-ce1c16e5-da0c-479f-bc6d-4bcdde314f4f req-b66516b7-410a-477a-a5f2-246fd12dfe0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Jan 05 18:14:13.279206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 445/937] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:14:13.300728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:13.303144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:13.307380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.307815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.308578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.309006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.444176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:13.452309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:13.453797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:13.454977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2bb55966-558b-462f-9df0-cbe2f7d0104d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.158081 Jan 05 18:14:13.455548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 493/938] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:13 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:13.808799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:13.809449 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:13.815478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.815952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:13.816761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:13.817342 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:14.010603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:14.018237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d441f854-770e-4d2a-b908-45672f96d014 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.213521 Jan 05 18:14:14.018796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 446/939] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:13 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:14.206857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:14.208263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:14.213979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:14.214459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:14.215290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:14.215725 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:14.334713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:14.341762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a7e64cc0-e22a-4941-99fa-6124cbe8f5cf tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.138603 Jan 05 18:14:14.342359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 494/940] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:14 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:14.472706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:14.473203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:14.479171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:14.479612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:14.480365 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:14.480796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:14.602195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:14.610276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:14.614888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:14.614888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-50e09870-1917-4d41-a563-a2a617f01af9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.144013 Jan 05 18:14:14.614888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 447/941] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:14 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:15.036573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:15.037232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:15.047116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.047572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.048355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.048791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.170277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:15.178357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cf68a052-7a04-4756-a70e-c58e11476096 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.146301 Jan 05 18:14:15.178909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 495/942] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:15 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:15.357408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:15.357951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:15.364513 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.364895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.365655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.366117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.487269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:15.494602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1ce71f76-b986-44b7-af16-2753ad8968a7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.140863 Jan 05 18:14:15.495161 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 448/943] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:15 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:15.630669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:15.631267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:15.636912 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.637354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.638137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.638568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.758695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:15.766702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:15.768187 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:15.769330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e121b14c-bb98-4bcc-b7e9-0676ada422c7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.142402 Jan 05 18:14:15.770416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 496/944] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:15 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:15.978601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:15.979087 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:15.984860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.985359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:15.986141 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:15.986573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.066828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'services' on Instance uuid 43be7c20-103d-483f-99e6-62880b672333 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:14:16.195683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:16.196284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:16.201945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.202423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.203179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.203607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.322700 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-004e439e-a0ec-4e35-b864-5e9b2d05f1ed tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments/dbd64c14-17bc-4ec7-afd1-877d404df473" status: 202 len: 0 microversion: 2.1 time: 0.347894 Jan 05 18:14:16.323871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 449/945] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:14:15 2022] DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments/dbd64c14-17bc-4ec7-afd1-877d404df473 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:14:16.326554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:16.335089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-64362bf5-ef28-400b-9583-be129b2f7b42 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.143797 Jan 05 18:14:16.335872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 497/946] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:16 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:16.511631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:16.512391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:16.518382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.518832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.520179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.520680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.647056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:16.654148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c95cedb9-f161-48a5-9d67-c22ab24adee4 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.146530 Jan 05 18:14:16.654706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 450/947] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:16 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:16.786720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:16.787271 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:16.792981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.793424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.794211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:16.794640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:16.911504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:16.919482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:16.920971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:16.922156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-499d0e07-e8cc-423c-8fad-37a7adcc0f8a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.139163 Jan 05 18:14:16.922704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 498/948] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:16 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:17.352828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:17.353423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:17.359166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.359609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:17.360362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.360896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:17.493615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:17.501277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3e815b99-b243-4eb2-8f3c-44122873ed4f tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.152430 Jan 05 18:14:17.501837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 451/949] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:17 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:17.670591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:17.671196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:17.677426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.680669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:17.680669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.680669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:17.802036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:17.809508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a444f48e-db13-416a-ab56-c46acc7262e5 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.142594 Jan 05 18:14:17.810099 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 499/950] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:17 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:17.940556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:17.941158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:17.947521 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.947961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:17.948752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:17.949182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.067252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.075421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.076915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.078093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9c3dfec5-8564-4a6a-9441-ea2cf6c5923d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.141242 Jan 05 18:14:18.078659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 452/951] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:17 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:18.499709 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fd92dce1-9524-466b-9f6e-64d6b91bb58b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:18.505326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd92dce1-9524-466b-9f6e-64d6b91bb58b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.505767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fd92dce1-9524-466b-9f6e-64d6b91bb58b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.517927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:18.519300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:18.525890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.526391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.527280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.527590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.527841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fd92dce1-9524-466b-9f6e-64d6b91bb58b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Going to try to stop instance {{(pid=116428) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Jan 05 18:14:18.656864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.665092 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-063cb417-351a-4502-b9ee-32289d5925cf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.150845 Jan 05 18:14:18.665655 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 453/952] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:18 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:18.720773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fd92dce1-9524-466b-9f6e-64d6b91bb58b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 202 len: 0 microversion: 2.1 time: 0.224478 Jan 05 18:14:18.721820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 500/953] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:14:18 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:14:18.736371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:18.736978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:18.742850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.746815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.746815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.746815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.827357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:18.828132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:18.835189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.835743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.836553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:18.836990 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:18.864761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.872018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b7158d39-2900-463a-8aaa-3fe5e19df2ff tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.139316 Jan 05 18:14:18.872582 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 454/954] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:18 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:18.955569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:18.963165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-de66b4b6-47c5-429e-a1dc-563d98ff3fb2 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.139979 Jan 05 18:14:18.963727 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 501/955] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:18 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:19.095749 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:19.096312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:19.102666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.103149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.103917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.104377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.221077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:19.229443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:19.230949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:19.232080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bcaa1395-9f35-4b9f-ab23-34096810fa3a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.140122 Jan 05 18:14:19.232633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 455/956] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:19 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:19.682563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:19.683266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:19.688953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.689414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.690188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.690615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.812538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:19.820219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-55606a6f-bff2-4bd1-9c00-86b6e047830c tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.141560 Jan 05 18:14:19.820787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 502/957] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:19 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:19.890659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:19.891200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:19.897437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.897888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.898689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.899132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.979986 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:19.980481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:19.986538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.987089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:19.987938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:19.988566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:20.020320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.027828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1ea5af3f-a12e-460b-8d35-4b98c5d0c094 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.140901 Jan 05 18:14:20.028402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 456/958] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:19 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:20.109381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.116970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a8fe4d71-96d4-48ba-92a6-64cd67aed514 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.141046 Jan 05 18:14:20.117532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 503/959] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:19 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:20.250578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:20.251189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:20.257245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:20.257699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:20.258537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:20.258971 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:20.378219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.386963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.388441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.389576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f7ebf260-2d47-404e-b234-822e3f266bcc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.142740 Jan 05 18:14:20.390182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 457/960] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:20 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:20.836472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:20.836989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:20.842745 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:20.843216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:20.843976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:20.844408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:20.962693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:20.970280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5afd81d0-78ef-4f2f-8eb9-16d0e659ecd5 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.137502 Jan 05 18:14:20.970833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 504/961] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:20 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:21.044437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:21.045090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:21.051408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.051855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.052658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.053090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.134157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:21.134799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:21.140884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.141334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.142136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.142577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.169838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:21.177944 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-89ec99c3-7609-4412-82b4-ded9929c33df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.137100 Jan 05 18:14:21.178710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 458/962] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:21 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:21.260288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:21.267650 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a411e297-d74d-48d5-8810-5b14ab71dc52 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.137535 Jan 05 18:14:21.268380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 505/963] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:21 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:21.407362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:21.407919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:21.413768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.414246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.415002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.415430 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.535241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:21.543412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:21.544908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:21.546089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7190e546-51c3-4d9d-be29-0f1aa144440f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.142457 Jan 05 18:14:21.546657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 459/964] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:21 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:21.987107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:21.987706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:21.993931 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.994415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:21.995173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:21.995603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.118806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.126275 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-255d9e69-0844-484c-9d17-96afdf7da4bf tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1755 microversion: 2.1 time: 0.142748 Jan 05 18:14:22.126826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 506/965] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:21 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1755 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:22.195145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:22.195746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:22.201426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.201870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.202654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.203085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.288425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:22.289127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:22.295212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.295767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.296618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.297123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.322534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.329823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ec445b72-df89-485e-bcf2-c4385c4e4690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.138831 Jan 05 18:14:22.330428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 460/966] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:22 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:22.416876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.423932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8b7be0c8-f06f-4416-9e26-2bbf504758f7 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.139289 Jan 05 18:14:22.424491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 507/967] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:22 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:22.564651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:22.565444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:22.571458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.571910 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.572683 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.573116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.695951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.704417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.705713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-0eb3d120-26aa-402a-8557-2aa7a06be243 req-65d187c0-75f2-40d7-8508-4f6c9ba02cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9ff186-8758-4b73-bc3d-0ebe16227f8c", "name": "network-vif-plugged", "status": "completed", "tag": "d0fa3b99-2186-40ac-a16e-0d7f9e869c83"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:22.705920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:22.707411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-02dc4020-4fc4-4e68-8050-1f4f3d84533a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.146474 Jan 05 18:14:22.707565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:14:22.707565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:14:22.718165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-0eb3d120-26aa-402a-8557-2aa7a06be243 req-65d187c0-75f2-40d7-8508-4f6c9ba02cae service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:22.718165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-0eb3d120-26aa-402a-8557-2aa7a06be243 req-65d187c0-75f2-40d7-8508-4f6c9ba02cae service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:22.723977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 461/968] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:22 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:22.728983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-0eb3d120-26aa-402a-8557-2aa7a06be243 req-65d187c0-75f2-40d7-8508-4f6c9ba02cae service nova] Creating event network-vif-plugged:d0fa3b99-2186-40ac-a16e-0d7f9e869c83 for instance 0e9ff186-8758-4b73-bc3d-0ebe16227f8c on hv-cinder-xena0 Jan 05 18:14:22.734817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-0eb3d120-26aa-402a-8557-2aa7a06be243 req-65d187c0-75f2-40d7-8508-4f6c9ba02cae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Jan 05 18:14:22.735411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 508/969] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:14:23.142695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:23.143302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:23.149654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.150167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.150953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.151385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.274410 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.277572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-88b7270e-5e9c-47fb-beca-67f7b4266571 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1758 microversion: 2.1 time: 0.138494 Jan 05 18:14:23.278242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 462/970] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:23 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1758 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:23.348552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:23.349159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:23.355590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.356035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.356791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.357221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.440593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:23.441743 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:23.447690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.448142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.448946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.449379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.478063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.485382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7f4dcdc7-c27d-4d31-afdc-dd57ebf1b445 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.141134 Jan 05 18:14:23.485951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 509/971] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:23 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:23.566646 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.574082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-82eae717-f883-4467-b2e7-10b30ea15790 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.137285 Jan 05 18:14:23.574652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 463/972] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:23 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:23.724997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:23.725609 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:23.731706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.732219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.732982 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:23.733413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:23.857132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.865645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.867217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:23.868306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dcf71a23-58a1-4d04-85c5-05d01820639b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.147530 Jan 05 18:14:23.868861 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 510/973] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:23 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:14:24.502191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:24.502805 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:24.514653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.515131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.515911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.516345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.591115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:24.591812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:24.598255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.599006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.599871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.600379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.657609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:24.665116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d65fca9c-0aa4-4871-ad0e-c3f42c525f78 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.166581 Jan 05 18:14:24.665695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 464/974] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:24 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:24.724821 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:24.732452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-278e1517-4f27-4f7d-9c0b-3443461c7878 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1313 microversion: 2.1 time: 0.145013 Jan 05 18:14:24.733790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 511/975] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:24 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:24.750377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-704adad4-d12f-4e9e-8a56-f3020face7f4 req-f3fc926e-5170-49d5-a6a9-bf428bbdc914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "name": "network-vif-plugged", "status": "completed", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:24.751950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:14:24.751950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:14:24.758891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-704adad4-d12f-4e9e-8a56-f3020face7f4 req-f3fc926e-5170-49d5-a6a9-bf428bbdc914 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.759341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-704adad4-d12f-4e9e-8a56-f3020face7f4 req-f3fc926e-5170-49d5-a6a9-bf428bbdc914 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.771086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-704adad4-d12f-4e9e-8a56-f3020face7f4 req-f3fc926e-5170-49d5-a6a9-bf428bbdc914 service nova] Creating event network-vif-plugged:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:14:24.776146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-704adad4-d12f-4e9e-8a56-f3020face7f4 req-f3fc926e-5170-49d5-a6a9-bf428bbdc914 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029682 Jan 05 18:14:24.776740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 465/976] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:14:24.885634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:24.886267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:24.891973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.892415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:24.893166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:24.893593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.012191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:25.021023 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:25.022758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:25.023981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e2bb644b-4ec2-4215-a18c-15bb088cb046 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.142089 Jan 05 18:14:25.024526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 512/977] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:24 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:25.683119 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:25.683816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:25.689962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.690440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.691292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.691856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.749911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:25.750558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:25.756413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.756873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.757655 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.758122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.810495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:25.817795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b1cab349-a8f2-4841-b6e3-577f711f2155 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.138670 Jan 05 18:14:25.818567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 466/978] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:25 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:25.881389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:25.888619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f1a30ae1-339c-4cb4-82e5-9e15daa4cb36 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1463 microversion: 2.1 time: 0.142331 Jan 05 18:14:25.889182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 513/979] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:25 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:25.925550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:25.926260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:25.931864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.932313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.933077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:25.933514 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:25.957212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:14:26.041286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:26.041816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:26.047839 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.048289 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.049060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.049498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.171626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:26.179949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:26.181422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:26.182639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2b921427-f60d-4cba-83b7-4fe8a66e2717 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.145168 Jan 05 18:14:26.183192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 514/980] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:26 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:26.191443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-83700242-0105-45ae-b923-3582e4878447 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 204 len: 0 microversion: 2.1 time: 0.269283 Jan 05 18:14:26.192028 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 467/981] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:14:25 2022] DELETE /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:14:26.199735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:26.201740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:26.206359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.207395 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.208252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.208687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.327572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:26.335608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4912268e-d8e9-4993-884b-91116e0bcf51 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1469 microversion: 2.1 time: 0.139299 Jan 05 18:14:26.336194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 515/982] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:26 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1469 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:26.834684 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:26.835376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:26.841134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.841585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.842377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:26.842813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:26.962823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:26.969964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-99253a54-2878-491a-a013-da6f636255c2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.139537 Jan 05 18:14:26.970558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 468/983] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:26 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:27.200603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:27.201162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:27.207040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.207494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:27.208262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.208701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:27.331483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:27.339746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:27.341240 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:27.342408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df1189cc-bddd-4119-9b34-a707c0e81270 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.145639 Jan 05 18:14:27.342954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 516/984] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:27 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:27.353237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:27.353907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:27.359563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.360008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:27.360836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.361180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:27.483254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:27.490600 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d2f0ed02-7d08-4795-93cb-16469d6c2d9d tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1469 microversion: 2.1 time: 0.141135 Jan 05 18:14:27.491175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 469/985] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:27 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1469 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:27.986763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:27.987363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:27.993388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.993828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:27.994698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:27.995134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.116298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:28.123476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bcf9fc55-57d5-4bc6-8a14-21271339946c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.140414 Jan 05 18:14:28.124061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 517/986] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:27 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:28.362649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:28.363773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:28.369275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:28.369725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.370535 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:28.370972 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.508277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:28.509721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:28.515702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:28.516157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.517133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:28.517572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.569680 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:28.587002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:28.587002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:28.587002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-90536939-e0b0-4b0c-99ec-95154165314b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1808 microversion: 2.20 time: 0.222867 Jan 05 18:14:28.587445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 470/987] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:28 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:28.654852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:28.662810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a5ce8493-7a3a-4739-a7d4-c768e9ffc728 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1469 microversion: 2.1 time: 0.158267 Jan 05 18:14:28.663382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 518/988] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:28 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:28.920060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-b6cc20b1-53ce-4090-9229-f223c0a7d7cd req-ff41e090-abca-46ae-91d4-8b5cf801c828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e9ff186-8758-4b73-bc3d-0ebe16227f8c", "name": "network-vif-deleted", "tag": "d0fa3b99-2186-40ac-a16e-0d7f9e869c83"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:28.921802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:14:28.921802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:14:28.930401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b6cc20b1-53ce-4090-9229-f223c0a7d7cd req-ff41e090-abca-46ae-91d4-8b5cf801c828 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:28.930844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b6cc20b1-53ce-4090-9229-f223c0a7d7cd req-ff41e090-abca-46ae-91d4-8b5cf801c828 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:28.943302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-b6cc20b1-53ce-4090-9229-f223c0a7d7cd req-ff41e090-abca-46ae-91d4-8b5cf801c828 service nova] Creating event network-vif-deleted:d0fa3b99-2186-40ac-a16e-0d7f9e869c83 for instance 0e9ff186-8758-4b73-bc3d-0ebe16227f8c on hv-cinder-xena0 Jan 05 18:14:28.948210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-b6cc20b1-53ce-4090-9229-f223c0a7d7cd req-ff41e090-abca-46ae-91d4-8b5cf801c828 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041943 Jan 05 18:14:28.949084 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 471/989] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:14:29.141038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:29.141538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:29.147907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.148350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.149109 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.149566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.276441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:29.283624 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4749a851-b0c3-4cab-a8e4-1a8fc5287db7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.146389 Jan 05 18:14:29.284177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 519/990] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:29 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:29.599826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:29.600508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:29.607046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.607456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.608549 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.608983 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.679804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:29.680575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:29.686776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.687298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.688085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.688525 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.719647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:29.720096 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:29.720540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lazy-loading 'fault' on Instance uuid 0e9ff186-8758-4b73-bc3d-0ebe16227f8c {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:14:29.736509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:29.745798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:29.747307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:29.748473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f06785ab-8897-427f-9034-d83256d0a2df tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1795 microversion: 2.20 time: 0.152882 Jan 05 18:14:29.749230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 472/991] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:14:29 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:14:29.765442 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316f68eb203c4aafb270fa4c7851aba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d66495117824c448493fd9b5c76a2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:29.774372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-120a03fe-23b5-42a1-a1d4-43c6faf82ba3 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 200 len: 1303 microversion: 2.1 time: 0.098972 Jan 05 18:14:29.775014 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 520/992] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:29 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:14:30.301337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:30.301977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:30.307986 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:30.308432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:30.309195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:30.309625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:30.429690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:30.436992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1e76306d-396a-4c25-aa18-e857a850f9c9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.139960 Jan 05 18:14:30.437567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 473/993] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:30 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:30.793223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:30.793735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] [instance: 0e9ff186-8758-4b73-bc3d-0ebe16227f8c] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:30.799533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:30.799973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:30.801058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:30.801412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:30.813975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] HTTP exception thrown: Instance 0e9ff186-8758-4b73-bc3d-0ebe16227f8c could not be found. Jan 05 18:14:30.814640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] Returning 404 to user: Instance 0e9ff186-8758-4b73-bc3d-0ebe16227f8c could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:14:30.815431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-02da645b-cc2e-4e47-9ff8-ab186c461a25 tempest-VolumesNegativeTest-1800361229 tempest-VolumesNegativeTest-1800361229-project] 10.222.0.26 "GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c" status: 404 len: 111 microversion: 2.1 time: 0.026048 Jan 05 18:14:30.816458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 521/994] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:30 2022] GET /compute/v2.1/servers/0e9ff186-8758-4b73-bc3d-0ebe16227f8c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:14:31.453386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:31.453994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:31.460710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:31.461186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:31.461957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:31.462419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:31.584078 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:31.591775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-49f676bc-d096-4e58-aedc-b71f15de0184 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.141993 Jan 05 18:14:31.592357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 474/995] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:31 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:32.608601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:32.609208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:32.618423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:32.618935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:32.619716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:32.620153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:32.740989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:32.748224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9b7d817e-9ead-4716-a7e6-c45728eb627a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.143364 Jan 05 18:14:32.748776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 522/996] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:32 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:33.764984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:33.765650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:33.771995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:33.772446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:33.773215 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:33.773650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:33.894931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:33.902241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d099d73b-9d3e-4da4-9a78-15a8a9fa8edd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1675 microversion: 2.1 time: 0.140877 Jan 05 18:14:33.902802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 475/997] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:33 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:34.919778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:34.920377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:34.926400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:34.926943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:34.927723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:34.928154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:35.058796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:35.066182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d52ebede-ee94-4776-a593-e206c2a5d9de tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1652 microversion: 2.1 time: 0.149973 Jan 05 18:14:35.066756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 523/998] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:34 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1652 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:35.083368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-550549d6-3ab8-423d-b22d-d97809a9c564 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:35.089275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-550549d6-3ab8-423d-b22d-d97809a9c564 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:35.089720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-550549d6-3ab8-423d-b22d-d97809a9c564 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:35.150229 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-550549d6-3ab8-423d-b22d-d97809a9c564 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Going to try to start instance {{(pid=116429) start /opt/stack/nova/nova/compute/api.py:2675}} Jan 05 18:14:35.291640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-550549d6-3ab8-423d-b22d-d97809a9c564 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action" status: 202 len: 0 microversion: 2.1 time: 0.212474 Jan 05 18:14:35.292163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 476/999] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:14:35 2022] POST /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:14:35.300285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:35.301126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:35.306981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:35.307436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:35.308222 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:35.308653 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:35.427586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:35.434658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a9c215ad-79da-4a80-b2b6-fcf1be009a24 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1661 microversion: 2.1 time: 0.138072 Jan 05 18:14:35.435243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 524/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:35 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1661 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:36.453819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:36.454574 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:36.461197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:36.461643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:36.462549 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:36.462942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:36.586484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:36.594446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-17f535f2-b0f4-49b1-ae92-1abb1d144be3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1661 microversion: 2.1 time: 0.145439 Jan 05 18:14:36.594984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 477/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:36 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1661 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:37.612633 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:37.613315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:37.619748 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:37.620193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:37.620953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:37.621384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:37.741833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:37.748911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d2c6e0ce-5cb4-4fc5-bce1-d88011a0824e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1665 microversion: 2.1 time: 0.139935 Jan 05 18:14:37.749464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 525/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:37 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1665 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:46.631382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:14:46.632433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:46.638205 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:46.638612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:46.639374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:46.639803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:46.662059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lazy-loading 'flavor' on Instance uuid 5647338f-7bc8-43fb-b562-0ddc5523a6a2 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:14:46.858526 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-15bde80d-f625-4045-9720-5a027283adeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "POST /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2/action" status: 202 len: 0 microversion: 2.1 time: 0.230607 Jan 05 18:14:46.859157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 478/1003] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:14:46 2022] POST /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:14:46.868387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:46.869005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:46.874837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:46.875275 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:46.876040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:46.876489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:46.995207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:47.002407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-acf0c3e2-ee4f-4dfc-915d-ed014909eb95 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.138350 Jan 05 18:14:47.002969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 526/1004] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:46 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:48.021046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:48.021748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:48.028891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:48.029336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:48.030124 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:48.030558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:48.388369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:48.395490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cc5a2064-b1b8-4d22-a08b-a9d233050a58 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.378482 Jan 05 18:14:48.396051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 479/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:48 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:49.411925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:49.412512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:49.418788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:49.419231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:49.419984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:49.420410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:49.535636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:49.542817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f4af6ab3-0fb6-4477-b38e-24047a590b92 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.134493 Jan 05 18:14:49.543383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 527/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:49 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:50.560659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:50.561212 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:50.566949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:50.567388 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:50.568137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:50.568561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:50.685829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:50.693164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8119f8de-10d3-4690-aadb-82fa501f3aa2 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.137748 Jan 05 18:14:50.693724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 480/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:50 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:51.709788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:51.710448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:51.716476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:51.716912 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:51.717669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:51.718127 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:51.838415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:51.845598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0d31ed96-bf21-479a-ac33-727f4932a979 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.139473 Jan 05 18:14:51.846176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 528/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:51 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:53.068478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:53.069096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:53.074860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:53.075315 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:53.076083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:53.076523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:53.194638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:53.202295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f2a9e485-4a81-404c-8376-aafb8ac4e7c6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.342779 Jan 05 18:14:53.202863 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 481/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:52 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:54.219760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:54.220388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:54.226126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:54.226579 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:54.227884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:54.228317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:54.343668 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:54.350961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-73788be0-a2ac-4e20-b164-d3a0664f89a7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.134876 Jan 05 18:14:54.351524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 529/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:54 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:55.368996 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:55.369596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:55.375335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:55.375781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:55.376539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:55.376965 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:55.493599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:55.500769 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-402a5ff3-28f4-4e2b-b3ce-dd5d2db9ae81 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.135929 Jan 05 18:14:55.501331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 482/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:55 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:56.517128 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:56.517645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:56.523378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:56.523820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:56.524659 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:56.525266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:56.640763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:56.647938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a5f2c4f6-3ab4-4830-9da1-3fab961a0882 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.134516 Jan 05 18:14:56.648491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 530/1012] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:56 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:57.664788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:57.665540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:57.671322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:57.671770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:57.672530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:57.672965 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:57.788085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:57.795406 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8b4db2d7-c62d-4fdd-83dc-52f14a7047e4 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.134240 Jan 05 18:14:57.795970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 483/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:57 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:58.812039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:58.812652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:58.818460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:58.818902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:58.819660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:58.820097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:58.941774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:14:58.949775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-84c17291-e56d-40d8-90e0-e985724826ec tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.141446 Jan 05 18:14:58.950570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 531/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:58 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:14:59.967289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:14:59.967891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:14:59.973617 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:59.974085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:14:59.974844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:14:59.975273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:00.097152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:00.104947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2b78a3a2-cab3-4a8e-b33c-b469f1b9e670 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.141241 Jan 05 18:15:00.107661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 484/1015] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:14:59 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:01.122740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:01.123344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:01.129168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:01.129625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:01.130438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:01.130875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:01.251217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:01.258322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-07bc7824-b0a1-4361-9cc0-667dc1d2efbf tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.139479 Jan 05 18:15:01.258928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 532/1016] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:01 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:02.275884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:02.281266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:02.282325 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:02.282762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:02.283528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:02.283985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:02.481681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:02.488777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-adaff92b-23b7-4307-904d-529156b4b29e tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.217272 Jan 05 18:15:02.489359 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 485/1017] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:02 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:03.505785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:03.506404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:03.512149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:03.512589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:03.513344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:03.513774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:03.631210 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:03.639484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0df9019e-dbd6-4eb3-b6de-84412001465c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.137492 Jan 05 18:15:03.640044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 533/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:03 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:04.656138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:04.656758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:04.662505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:04.662951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:04.663718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:04.664153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:04.782722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:04.790620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a5def485-faf6-4179-b2a3-31824e2aca75 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.137481 Jan 05 18:15:04.791182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 486/1019] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:04 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:05.809093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:05.809691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:05.815415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:05.815862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:05.816611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:05.817040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:05.938078 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:05.945532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bbb33dfa-1907-4ac7-8c4d-e5f72846d86a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1568 microversion: 2.1 time: 0.140707 Jan 05 18:15:05.946125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 534/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:05 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:05.961567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:05.962230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:05.968091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:05.968536 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:05.969407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:05.969835 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:06.215609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-379d0f35-fc64-445f-bd18-57db19aca0d3 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "POST /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2/action" status: 202 len: 0 microversion: 2.1 time: 0.257649 Jan 05 18:15:06.216220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 487/1021] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:15:05 2022] POST /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:15:06.224296 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:06.225544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:06.231953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:06.232402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:06.233176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:06.233612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:06.381803 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:06.391700 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9a41be4e-c8c9-45ae-a6b3-9dce9e06d023 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1516 microversion: 2.1 time: 0.168334 Jan 05 18:15:06.391700 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 535/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:06 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:15:07.405982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:07.406556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:07.412210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:07.412615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:07.413376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:07.413811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:07.531432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:07.537966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0ae65316-c1a7-46a2-a298-d6255cc7efa1 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1518 microversion: 2.1 time: 0.136372 Jan 05 18:15:07.538558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 488/1023] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:07 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1518 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:08.555693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:08.556285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:08.562005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:08.562472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:08.563264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:08.563692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:08.687784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:08.695253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-41c2bb03-8ade-4534-a0af-d478761905b7 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.143197 Jan 05 18:15:08.695972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 536/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:08 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:08.774457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-d8037608-40dd-44c8-baf5-a52012f0e708 req-cc72f556-5829-4cfa-8c11-a9e847851283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:08.779370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:08.779370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:15:08.785252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d8037608-40dd-44c8-baf5-a52012f0e708 req-cc72f556-5829-4cfa-8c11-a9e847851283 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:08.785694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d8037608-40dd-44c8-baf5-a52012f0e708 req-cc72f556-5829-4cfa-8c11-a9e847851283 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:08.797213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-d8037608-40dd-44c8-baf5-a52012f0e708 req-cc72f556-5829-4cfa-8c11-a9e847851283 service nova] Creating event network-vif-unplugged:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:15:08.802389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-d8037608-40dd-44c8-baf5-a52012f0e708 req-cc72f556-5829-4cfa-8c11-a9e847851283 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031526 Jan 05 18:15:08.803005 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 489/1025] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:09.712823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:09.713430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:09.719756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:09.720196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:09.720953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:09.721383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:09.840652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:09.847785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5cfaf604-ff81-4b18-8cd1-e7bf05089aeb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.138931 Jan 05 18:15:09.848373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 537/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:09 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:10.865956 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:10.866754 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:10.873725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:10.874203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:10.874969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:10.875404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:10.992014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:11.000096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-24b2cc56-e9c6-4033-bb1a-72b676caa7a6 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.138156 Jan 05 18:15:11.000661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 490/1027] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:10 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:12.017496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:12.018163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:12.023918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:12.024368 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:12.025132 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:12.025567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:12.142176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:12.149324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-414b19c4-370b-4d38-bd38-2d183432a5f9 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.135550 Jan 05 18:15:12.149884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 538/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:12 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:13.166758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:13.167361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:13.173744 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:13.174214 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:13.174964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:13.175389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:13.290976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:13.298335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7907740b-93a9-499b-846e-d598b83ba72a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.135206 Jan 05 18:15:13.298896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 491/1029] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:13 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:14.315358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:14.315996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:14.321710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:14.322196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:14.322956 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:14.323388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:14.444836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:14.452290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e402e577-5be7-4add-8042-8dbbf6c1e923 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.140578 Jan 05 18:15:14.452863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 539/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:14 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:15.468990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:15.469591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:15.475616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:15.476068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:15.476841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:15.477308 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:15.548658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:15:15.549269 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:15:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:15:15.600106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:15.609109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9e506514-4746-4be3-9090-1dba012e4432 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.143920 Jan 05 18:15:15.609683 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 492/1031] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:15 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:16.626405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:16.627011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:16.632969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:16.633422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:16.634257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:16.634698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:16.753511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:16.760822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1f518eb9-6b34-4da6-bf50-e28c30f080b0 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.138529 Jan 05 18:15:16.761322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 540/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:16 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:17.777691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:17.778323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:17.784563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:17.786266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:17.786266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:17.786266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:17.909044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:17.916263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc77077e-8ec0-461e-b18a-9227d4eb6a25 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.142222 Jan 05 18:15:17.916824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 493/1033] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:17 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:18.933692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:18.935273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:18.940444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:18.940894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:18.941658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:18.942124 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:19.061755 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:19.069008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bb2ff8db-7b0e-4623-97cd-b07f4f105b28 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1574 microversion: 2.1 time: 0.139019 Jan 05 18:15:19.069572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 541/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:18 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:20.085649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:20.086282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:20.092662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:20.093093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:20.093853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:20.094313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:20.213163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:20.220924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-92c5d1ae-416f-4e59-868c-767559f95031 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1561 microversion: 2.1 time: 0.138930 Jan 05 18:15:20.221492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 494/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:20 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1561 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:22.909044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-971e1bcb-7a39-4660-b6c2-fb27c56c3d89 req-084e38eb-dc0d-4698-b343-a8c73e179443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "name": "network-vif-plugged", "status": "completed", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:22.910789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:22.910789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:15:22.917232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-971e1bcb-7a39-4660-b6c2-fb27c56c3d89 req-084e38eb-dc0d-4698-b343-a8c73e179443 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:22.917689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-971e1bcb-7a39-4660-b6c2-fb27c56c3d89 req-084e38eb-dc0d-4698-b343-a8c73e179443 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:22.928919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-971e1bcb-7a39-4660-b6c2-fb27c56c3d89 req-084e38eb-dc0d-4698-b343-a8c73e179443 service nova] Creating event network-vif-plugged:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:15:22.933951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-971e1bcb-7a39-4660-b6c2-fb27c56c3d89 req-084e38eb-dc0d-4698-b343-a8c73e179443 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028460 Jan 05 18:15:22.934666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 542/1036] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:32.178262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: ERROR oslo.messaging._drivers.impl_rabbit [-] [48f506dd-d4b3-41a7-9e1b-cfc01d4007b3] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 05 18:15:32.181471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:32.181984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:32.188508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:32.188948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:32.189710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:32.190176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:32.213907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:15:32.522369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9d9d6c60-c933-4c68-b861-6a7a9b53f085 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 204 len: 0 microversion: 2.1 time: 0.345197 Jan 05 18:15:32.522878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 495/1037] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:15:32 2022] DELETE /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:15:32.531766 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:32.536589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:32.538641 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:32.539097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:32.539877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:32.540312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:32.663524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:32.671849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b7dbb8bd-63c7-4954-b05c-63ecbeb5c111 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1575 microversion: 2.1 time: 0.144446 Jan 05 18:15:32.672416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 543/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:32 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:33.693686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:33.694403 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:33.701905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:33.702385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:33.703166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:33.703605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:33.718816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] [48f506dd-d4b3-41a7-9e1b-cfc01d4007b3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36696. Jan 05 18:15:33.827083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:33.834420 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-33717d10-204b-44db-9ba6-2c96b2a6657a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1575 microversion: 2.1 time: 0.144761 Jan 05 18:15:33.834983 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 496/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:33 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:34.851697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:34.852307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:34.855195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8f7e1074-255c-4bd1-b569-9f47c942824b] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 05 18:15:34.860078 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:34.860532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:34.861310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:34.861747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:34.981817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:34.989700 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e28fd459-ba81-4e3d-997d-3c2bcab66a91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1575 microversion: 2.1 time: 0.141771 Jan 05 18:15:34.990325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 544/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:34 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:35.719699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-f16e1764-9aa3-42a0-999d-99a11f64f3a1 req-43cddc0e-5c12-45ce-bd51-d2c3aa06a997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d49986c-47f7-4efe-ab72-3178533fa6e3", "name": "network-vif-deleted", "tag": "864ddde1-36f6-4e8a-836a-ca791ef77d5f"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:35.721291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:35.721291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:15:35.728481 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f16e1764-9aa3-42a0-999d-99a11f64f3a1 req-43cddc0e-5c12-45ce-bd51-d2c3aa06a997 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:35.728919 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f16e1764-9aa3-42a0-999d-99a11f64f3a1 req-43cddc0e-5c12-45ce-bd51-d2c3aa06a997 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:35.739796 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-f16e1764-9aa3-42a0-999d-99a11f64f3a1 req-43cddc0e-5c12-45ce-bd51-d2c3aa06a997 service nova] Creating event network-vif-deleted:864ddde1-36f6-4e8a-836a-ca791ef77d5f for instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 on hv-cinder-xena0 Jan 05 18:15:35.744781 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-f16e1764-9aa3-42a0-999d-99a11f64f3a1 req-43cddc0e-5c12-45ce-bd51-d2c3aa06a997 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029000 Jan 05 18:15:35.745554 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 497/1041] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:36.006521 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:36.007331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:36.014596 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:36.015055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:36.015848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:36.016293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:36.032977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] [8f7e1074-255c-4bd1-b569-9f47c942824b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36708. Jan 05 18:15:36.079603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:36.086923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a2f4b4ba-16da-47fb-9245-825d1eecd3e9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1223 microversion: 2.1 time: 0.084146 Jan 05 18:15:36.087482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 545/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:36 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:37.104624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:37.105541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:37.112627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:37.113080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:37.113861 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:37.114330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:37.143705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:37.144157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:37.144602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lazy-loading 'fault' on Instance uuid 5d49986c-47f7-4efe-ab72-3178533fa6e3 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:15:37.184693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:37.192287 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-65614697-0636-452c-9dd6-b9976fc86113 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 200 len: 1228 microversion: 2.1 time: 0.091961 Jan 05 18:15:37.192843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 498/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:37 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:38.208962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:38.209545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:38.215307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:38.215754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:38.216517 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:38.216954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:38.230500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] HTTP exception thrown: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. Jan 05 18:15:38.231074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Returning 404 to user: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:15:38.231902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d173407a-4c8f-43e0-b2fe-2671e60f418c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 404 len: 111 microversion: 2.1 time: 0.026608 Jan 05 18:15:38.232409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 546/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:38 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:15:38.324496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-969790242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84115276", "security_groups": [{"name": "tempest-secgroup-smoke-143875598"}], "block_device_mapping_v2": [{"uuid": "2364833e-d993-4884-b3fc-8cfd813e03f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f66398-92a1-4614-82f3-d4ba84635ba6"}]}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:38.427307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] validate_networks() for [('f6f66398-92a1-4614-82f3-d4ba84635ba6', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:15:38.779135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:15:38.780186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:15:38.780652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:15:38.781083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:15:38.781490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:15:38.789772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:38.790249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:38.791045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:38.791473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:38.809100 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:15:38.813495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for user 15c202797c1440e1beb37e997904ac04 and project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:15:38.874462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:15:38.876695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2364833e-d993-4884-b3fc-8cfd813e03f1',volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:15:39.179947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-25271b08-d73a-4956-903a-d5d7391de497 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.859092 Jan 05 18:15:39.180747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 499/1045] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:15:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:15:39.190914 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-29757f38-8a21-42cb-bfb6-b93111d398b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:39.191520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-29757f38-8a21-42cb-bfb6-b93111d398b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:39.244864 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-29757f38-8a21-42cb-bfb6-b93111d398b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:39.251894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-29757f38-8a21-42cb-bfb6-b93111d398b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1092 microversion: 2.1 time: 0.064544 Jan 05 18:15:39.252463 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 547/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:39 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1092 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:40.269329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:40.269939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:40.276015 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:40.276473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:40.277289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:40.277720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:40.344400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:40.351675 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cb87b3d0-ce2f-4902-90bc-cde4c094c38a tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1190 microversion: 2.1 time: 0.086032 Jan 05 18:15:40.352177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 500/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:40 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:41.368718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:41.369419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:41.375698 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:41.376150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:41.376939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:41.377376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:41.440003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:41.447333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b36483b5-5e4f-4dda-8757-07097fd20c85 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1208 microversion: 2.1 time: 0.082308 Jan 05 18:15:41.447896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 548/1048] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:41 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:42.464718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:42.466186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:42.475172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:42.476233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:42.477209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:42.477895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:42.658871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:42.667070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-eccdeb6c-d9da-41f6-8ed9-d7d9b5b5ee49 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1275 microversion: 2.1 time: 0.206124 Jan 05 18:15:42.667676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 501/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:42 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:15:42.693571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-57047802-d3e7-4d71-ac0c-c42e17048300 req-51c65f08-a3ae-430c-9385-06683c689500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8082cfa-4412-4f34-ba49-ff82c3abef30", "tag": "cc53b920-be82-409d-983b-4ac61b3c409d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:42.695330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:42.695330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:15:42.706273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-57047802-d3e7-4d71-ac0c-c42e17048300 req-51c65f08-a3ae-430c-9385-06683c689500 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:42.707071 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-57047802-d3e7-4d71-ac0c-c42e17048300 req-51c65f08-a3ae-430c-9385-06683c689500 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:42.719693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-57047802-d3e7-4d71-ac0c-c42e17048300 req-51c65f08-a3ae-430c-9385-06683c689500 service nova] Creating event network-changed:cc53b920-be82-409d-983b-4ac61b3c409d for instance d8082cfa-4412-4f34-ba49-ff82c3abef30 on hv-cinder-xena0 Jan 05 18:15:42.724871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-57047802-d3e7-4d71-ac0c-c42e17048300 req-51c65f08-a3ae-430c-9385-06683c689500 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037073 Jan 05 18:15:42.730203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 549/1050] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:43.684573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:43.685164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:43.692728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:43.693236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:43.694044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:43.694473 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:43.815332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:43.822789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c2c16210-58fb-41d7-b231-3a40c68c3118 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.142282 Jan 05 18:15:43.828968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 502/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:43 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:44.840051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:44.840710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:44.846718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:44.847173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:44.847953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:44.848388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:44.969740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:44.976968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-35e25323-88b4-4420-b5a0-93f7efdc55b1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.141054 Jan 05 18:15:44.977527 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 550/1052] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:44 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:45.994502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:45.995127 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:46.000940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:46.001383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:46.002266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:46.002699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:46.128154 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:46.135541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b51fa72e-c814-460c-af13-6cd9c8477512 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.144626 Jan 05 18:15:46.136157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 503/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:45 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:47.152069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:47.152723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:47.158592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:47.159040 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:47.159808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:47.160245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:47.257480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-563225626"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:47.258007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:47.263687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:47.264186 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:47.265092 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:47.265526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:47.280508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:47.287629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-96684068-e42f-404e-bd91-2b95e4441b36 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.139169 Jan 05 18:15:47.288392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 504/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:47 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:47.379439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.network.security_group_api [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Removing security group 9d582619-dee7-4eb3-8839-49d2ea43f8b4 from port ed059967-44ef-462e-a799-7ce65c5e7e04 Jan 05 18:15:47.752036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-84347c81-7195-42d2-afe7-bfa440cfbe17 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action" status: 202 len: 0 microversion: 2.1 time: 0.603483 Jan 05 18:15:47.755838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 551/1055] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:15:47 2022] POST /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:15:47.763112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-e65db10c-7611-46cb-940f-302df2626d3b req-9c573085-6dac-43ec-a4e8-5da6453d8031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:47.765503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:47.765503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:15:47.775408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-e65db10c-7611-46cb-940f-302df2626d3b req-9c573085-6dac-43ec-a4e8-5da6453d8031 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:47.776170 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-e65db10c-7611-46cb-940f-302df2626d3b req-9c573085-6dac-43ec-a4e8-5da6453d8031 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:47.803063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-e65db10c-7611-46cb-940f-302df2626d3b req-9c573085-6dac-43ec-a4e8-5da6453d8031 service nova] Creating event network-changed:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:15:47.813603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-e65db10c-7611-46cb-940f-302df2626d3b req-9c573085-6dac-43ec-a4e8-5da6453d8031 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053915 Jan 05 18:15:47.814847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 505/1056] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:48.305200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:48.305813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:48.312380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:48.313050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:48.313858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:48.314631 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:48.539648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:48.547775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f4cc1af6-f555-48e3-a929-ffaa5c37a4bd tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.246459 Jan 05 18:15:48.548283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 552/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:48 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:49.344311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:49.344894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:49.350995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.351469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.352259 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.352931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.434603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lazy-loading 'services' on Instance uuid ea958fe0-b69b-4f60-a362-bf91e198eb24 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:15:49.564887 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:49.565592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:49.571374 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.571906 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.572776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.573295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.606131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-712bef9c-8ae7-4b4e-bb66-efdfafb016d2 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments/83b08bb4-2f03-46e0-9a68-e35a3de105ba" status: 202 len: 0 microversion: 2.1 time: 0.265957 Jan 05 18:15:49.607319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 506/1058] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:15:49 2022] DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments/83b08bb4-2f03-46e0-9a68-e35a3de105ba => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:15:49.622059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:49.623326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:49.630069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.630528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.631311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.631751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.661382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b1f1bae4-fa1e-473e-bfc1-7c0e90beab07 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Jan 05 18:15:49.662299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 507/1059] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:15:49 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:49.710435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:49.719615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-49389f4a-20fb-40ce-8d0e-6d7532eae345 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.159051 Jan 05 18:15:49.723285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 553/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:49 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:15:49.830166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-71bae2dd-b007-457c-9be2-7ea3a0403ed3 req-ccef4488-8244-4e60-82a4-8d36c1480b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:49.831679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:49.831679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:15:49.838364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-71bae2dd-b007-457c-9be2-7ea3a0403ed3 req-ccef4488-8244-4e60-82a4-8d36c1480b46 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:49.843684 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-71bae2dd-b007-457c-9be2-7ea3a0403ed3 req-ccef4488-8244-4e60-82a4-8d36c1480b46 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:49.851106 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-71bae2dd-b007-457c-9be2-7ea3a0403ed3 req-ccef4488-8244-4e60-82a4-8d36c1480b46 service nova] Creating event network-changed:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:15:49.856288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-71bae2dd-b007-457c-9be2-7ea3a0403ed3 req-ccef4488-8244-4e60-82a4-8d36c1480b46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030121 Jan 05 18:15:49.856896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 508/1061] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:50.672829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:50.673809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:50.679459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:50.679902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:50.680660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:50.681090 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:50.710045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-17289566-5f33-4c76-b34a-dda3e76faa16 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040915 Jan 05 18:15:50.710592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 554/1062] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:15:50 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:50.736844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:50.737542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:50.743546 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:50.743997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:50.744766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:50.745204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:50.870853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:50.878992 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7dccc017-ea33-43d2-b86b-0ac7355c871e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.146166 Jan 05 18:15:50.879553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 509/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:50 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:51.722170 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:51.723106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:51.729340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.729793 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:51.730599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.731123 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:51.759824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7d2f16f2-2baa-4841-8ae5-0fafa34dfefa tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041739 Jan 05 18:15:51.760375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 555/1064] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:15:51 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:15:51.769729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:51.770283 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:51.776297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.776748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:51.777525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.777962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:51.853402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] HTTP exception thrown: Instance ea958fe0-b69b-4f60-a362-bf91e198eb24 is not attached to volume 83b08bb4-2f03-46e0-9a68-e35a3de105ba Jan 05 18:15:51.854163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Returning 404 to user: Instance ea958fe0-b69b-4f60-a362-bf91e198eb24 is not attached to volume 83b08bb4-2f03-46e0-9a68-e35a3de105ba {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:15:51.854997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d182754c-e022-4a37-af16-0b54df3ff4e8 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments/83b08bb4-2f03-46e0-9a68-e35a3de105ba" status: 404 len: 154 microversion: 2.1 time: 0.089058 Jan 05 18:15:51.855538 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 510/1065] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:15:51 2022] DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24/os-volume_attachments/83b08bb4-2f03-46e0-9a68-e35a3de105ba => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:15:51.895840 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:51.896507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:51.902217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.905116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:51.905116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:51.905116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:52.022670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:52.031696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a1181f28-65b6-465e-96ce-b409786e4f23 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.139534 Jan 05 18:15:52.032268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 556/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:51 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:53.049138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:53.049788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:53.055439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.055875 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.056630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.057057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.101044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:53.101571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:53.107432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.108713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.109138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.109563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.133913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:15:53.181204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:53.184426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d884227b-2367-47fb-985e-3b8b585aab73 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.139408 Jan 05 18:15:53.184989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 511/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:53 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:53.407921 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-49ccb659-1e3f-4648-bebe-aa93f1b52344 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 204 len: 0 microversion: 2.1 time: 0.310141 Jan 05 18:15:53.408426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 557/1068] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:15:53 2022] DELETE /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:15:53.416318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:53.416976 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:53.423884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.437350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.437350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:53.437350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:53.542733 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:53.550496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-00892337-1d6e-4a35-a15e-9a8e698666e3 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1553 microversion: 2.1 time: 0.137744 Jan 05 18:15:53.551065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 512/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:53 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:54.202663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:54.203356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:54.209008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:54.209455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:54.210253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:54.210689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:54.331750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:54.338862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-58ef39fe-a525-48bb-822b-d7e826ed8042 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.140947 Jan 05 18:15:54.339423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 558/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:54 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:54.567470 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:54.567989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:54.573776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:54.574258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:54.575028 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:54.575463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:54.696555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:54.704349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0bf65d17-bce9-414c-b827-8195ca09981d tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1553 microversion: 2.1 time: 0.140567 Jan 05 18:15:54.704926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 513/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:54 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1553 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:55.355534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:55.356214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:55.362650 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:55.363107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:55.363886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:55.364325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:55.484309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:55.491392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2e2ec8b4-c32a-4857-b9d6-97621a63840d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.139757 Jan 05 18:15:55.491961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 559/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:55 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:55.720966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:55.721503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:55.727254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:55.727953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:55.728704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:55.729133 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:55.870825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:55.878179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ba820ad6-f5e2-487c-ab48-3763c570d987 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1553 microversion: 2.1 time: 0.161356 Jan 05 18:15:55.878728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 514/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:55 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:56.345204 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-3caf628a-6b14-4818-aba4-ae256314637d req-d282c888-6aa3-4e71-8ebe-70b448ab0b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea958fe0-b69b-4f60-a362-bf91e198eb24", "name": "network-vif-deleted", "tag": "ed059967-44ef-462e-a799-7ce65c5e7e04"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:56.346750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:56.346750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:15:56.353544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3caf628a-6b14-4818-aba4-ae256314637d req-d282c888-6aa3-4e71-8ebe-70b448ab0b6d service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.356366 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3caf628a-6b14-4818-aba4-ae256314637d req-d282c888-6aa3-4e71-8ebe-70b448ab0b6d service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.364611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-3caf628a-6b14-4818-aba4-ae256314637d req-d282c888-6aa3-4e71-8ebe-70b448ab0b6d service nova] Creating event network-vif-deleted:ed059967-44ef-462e-a799-7ce65c5e7e04 for instance ea958fe0-b69b-4f60-a362-bf91e198eb24 on hv-cinder-xena0 Jan 05 18:15:56.369540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-3caf628a-6b14-4818-aba4-ae256314637d req-d282c888-6aa3-4e71-8ebe-70b448ab0b6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028972 Jan 05 18:15:56.370171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 560/1074] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:15:56.509761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:56.510316 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:56.516706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.517279 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.518080 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.522760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.640601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:56.648144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6c7cacbb-98aa-4fc4-a836-8766487932e5 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.142028 Jan 05 18:15:56.648733 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 515/1075] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:56 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:56.895379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:56.895996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:56.901964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.902440 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.903197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.903628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.909236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:56.909736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:56.915384 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.915834 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.916607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.917045 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.933285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:56.933726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:56.934197 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lazy-loading 'fault' on Instance uuid ea958fe0-b69b-4f60-a362-bf91e198eb24 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:15:56.946580 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-29881a0c-99f8-4862-b663-dc2b3892bd82 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments/8e91302c-8061-475a-b9e2-82445bdac491" status: 200 len: 194 microversion: 2.20 time: 0.041258 Jan 05 18:15:56.947176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 516/1076] 10.222.0.26 () {60 vars in 1453 bytes} [Wed Jan 5 18:15:56 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments/8e91302c-8061-475a-b9e2-82445bdac491 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:15:56.974287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b5dfba75e2467bb6b569ec2c833e42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c753dd0d3b2f4098a76e0e6a57614fa4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:56.981902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e3f78865-aab4-4a2d-9f85-341a88ff6335 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 200 len: 1347 microversion: 2.1 time: 0.090583 Jan 05 18:15:56.983054 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 561/1077] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:56 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 1347 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:57.010404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:57.010904 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:57.016763 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.017192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.017967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.018430 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.101560 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lazy-loading 'services' on Instance uuid 75a21fb6-f469-48ac-81fb-ed035fec00b8 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:15:57.304207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-68d3dcc7-d986-4cb4-85b9-50f8616282c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments/8e91302c-8061-475a-b9e2-82445bdac491" status: 202 len: 0 microversion: 2.20 time: 0.297185 Jan 05 18:15:57.304735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 517/1078] 10.222.0.26 () {60 vars in 1456 bytes} [Wed Jan 5 18:15:57 2022] DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments/8e91302c-8061-475a-b9e2-82445bdac491 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:15:57.314298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:57.315211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:57.320987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.321451 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.322228 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.322656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.351508 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c7957b28-c118-416c-b88d-86bc35fa9e58 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041846 Jan 05 18:15:57.352047 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 562/1079] 10.222.0.26 () {60 vars in 1342 bytes} [Wed Jan 5 18:15:57 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:15:57.665083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:57.665778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:57.672230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.672673 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.673437 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:57.673868 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:57.792298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:57.799626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1dd4550e-0772-43a2-8351-12e315767813 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.138550 Jan 05 18:15:57.800200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 518/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:57 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:57.999677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:58.000310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [instance: ea958fe0-b69b-4f60-a362-bf91e198eb24] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:58.005925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.006403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.007171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.007722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.021381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] HTTP exception thrown: Instance ea958fe0-b69b-4f60-a362-bf91e198eb24 could not be found. Jan 05 18:15:58.022081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Returning 404 to user: Instance ea958fe0-b69b-4f60-a362-bf91e198eb24 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:15:58.022929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-06cd441c-83d6-4365-a841-c84777c98705 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24" status: 404 len: 111 microversion: 2.1 time: 0.027535 Jan 05 18:15:58.023448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 563/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:57 2022] GET /compute/v2.1/servers/ea958fe0-b69b-4f60-a362-bf91e198eb24 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:15:58.031792 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ef416e89-f0c5-44be-a464-aa1e91a7b379 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] Calling method '.version_select at 0x7f73448f2dc0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:58.035117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef416e89-f0c5-44be-a464-aa1e91a7b379 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [a693e300-6535-4d9a-a4e5-bed6bc478bb7] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 05 18:15:58.363952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:58.364966 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:58.370610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.374235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.374235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.374235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.401808 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6cafadc4-5a4e-4f4f-a340-45af0ab2492f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041620 Jan 05 18:15:58.402390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 564/1082] 10.222.0.26 () {60 vars in 1342 bytes} [Wed Jan 5 18:15:58 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:15:58.815853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:58.816452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:58.822224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.822670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.823458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:58.823890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:58.945540 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:15:58.953011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3d5c66d1-0fdc-4a39-ab83-f9cef526e7c7 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.140807 Jan 05 18:15:58.953571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 565/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:58 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:15:59.043970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef416e89-f0c5-44be-a464-aa1e91a7b379 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] [a693e300-6535-4d9a-a4e5-bed6bc478bb7] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36860. Jan 05 18:15:59.134450 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ef416e89-f0c5-44be-a464-aa1e91a7b379 tempest-TestMinimumBasicScenario-1277277018 tempest-TestMinimumBasicScenario-1277277018-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371138591" status: 202 len: 0 microversion: 2.1 time: 1.106477 Jan 05 18:15:59.135041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 519/1084] 10.222.0.26 () {58 vars in 1268 bytes} [Wed Jan 5 18:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-371138591 => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:15:59.194747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-bdd18a23-6c21-41d0-b5e1-1906be49b023 req-c6513234-574e-4658-995f-0601e9aea3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8082cfa-4412-4f34-ba49-ff82c3abef30", "name": "network-vif-plugged", "status": "completed", "tag": "cc53b920-be82-409d-983b-4ac61b3c409d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:15:59.196962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:15:59.196962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:15:59.203929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-bdd18a23-6c21-41d0-b5e1-1906be49b023 req-c6513234-574e-4658-995f-0601e9aea3cd service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.204859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-bdd18a23-6c21-41d0-b5e1-1906be49b023 req-c6513234-574e-4658-995f-0601e9aea3cd service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.215848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-bdd18a23-6c21-41d0-b5e1-1906be49b023 req-c6513234-574e-4658-995f-0601e9aea3cd service nova] Creating event network-vif-plugged:cc53b920-be82-409d-983b-4ac61b3c409d for instance d8082cfa-4412-4f34-ba49-ff82c3abef30 on hv-cinder-xena0 Jan 05 18:15:59.221534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-bdd18a23-6c21-41d0-b5e1-1906be49b023 req-c6513234-574e-4658-995f-0601e9aea3cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030364 Jan 05 18:15:59.222154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 566/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:15:59.413539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:59.414455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:59.421492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.421934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.422740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.423177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.454046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-23aab5b9-3143-4c43-957b-eecfd9136aaf tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044432 Jan 05 18:15:59.454793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 520/1086] 10.222.0.26 () {60 vars in 1342 bytes} [Wed Jan 5 18:15:59 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:15:59.518851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:59.519447 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:59.525299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.525702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.526592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.526908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.551784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:15:59.893571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-213d8281-eae4-466a-be4c-bc4f73c0083d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 204 len: 0 microversion: 2.20 time: 0.379677 Jan 05 18:15:59.894218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 567/1087] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jan 5 18:15:59 2022] DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 18:15:59.902276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:59.902958 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:59.908790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.909241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.909990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.910452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.969598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:15:59.970320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:15:59.978205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.979317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:15:59.981052 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:15:59.981394 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:00.035214 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:00.044659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:00.047143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:00.048531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0734afa9-c56d-4233-a7da-1bd7f96d8c03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.149983 Jan 05 18:16:00.059308 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 521/1088] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:15:59 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:00.111411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:00.118613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fe6a6376-6762-44c4-a9f7-c76b6e778866 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.153080 Jan 05 18:16:00.119165 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 568/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:15:59 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:01.067190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:01.067924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:01.073694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:01.074172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:01.074945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:01.075381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:01.135297 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:01.135903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:01.142519 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:01.143256 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:01.144149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:01.144794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:01.284911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:01.289286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:01.294211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-be6c2d62-c7fd-4186-ba7b-85db586e16b8 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1263 microversion: 2.1 time: 0.162436 Jan 05 18:16:01.298824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:01.300663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:01.301471 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 569/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:01 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:01.302309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-240ab9a8-6d8e-4c6f-ab24-adc6b33458c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.238834 Jan 05 18:16:01.303007 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 522/1091] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:01 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:16:02.312043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:02.313265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:02.322441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:02.323050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:02.323372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.323895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.324753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.325256 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.329618 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.330283 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.331510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.332219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.456077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:02.463677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4d795e70-c553-4164-8242-d24ed104f35d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1449 microversion: 2.1 time: 0.156062 Jan 05 18:16:02.464249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 570/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:02 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:02.485874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:02.486909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:02.492954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.493628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.494713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:02.495322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:02.506908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:02.516618 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:02.518751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:02.520147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-403270ab-999b-4a8f-afea-86990c7ab9c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1723 microversion: 2.20 time: 0.201606 Jan 05 18:16:02.521091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 523/1093] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:02 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:02.718253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:02.726142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dace572a-4fc0-4bdd-9f81-0f6131e9be10 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1449 microversion: 2.1 time: 0.245446 Jan 05 18:16:02.738530 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 571/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:02 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1449 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:03.538676 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:03.539558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:03.546152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:03.546716 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:03.547715 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:03.548951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:03.624878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:03.633585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:03.635305 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:03.641484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bc23d196-28c5-4a4d-a06a-af2b6150214c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1656 microversion: 2.20 time: 0.101917 Jan 05 18:16:03.641484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 524/1095] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:03 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1656 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:04.118955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-8bc1c264-b471-4880-872e-2500083cdcbd req-c66f50f8-5cc5-4fd6-b5bc-938c15f2b9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a21fb6-f469-48ac-81fb-ed035fec00b8", "name": "network-vif-deleted", "tag": "c5a45800-a3d4-41a3-b81d-2714d69e10a8"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:04.120658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:04.120658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:16:04.134611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8bc1c264-b471-4880-872e-2500083cdcbd req-c66f50f8-5cc5-4fd6-b5bc-938c15f2b9b9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:04.135070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-8bc1c264-b471-4880-872e-2500083cdcbd req-c66f50f8-5cc5-4fd6-b5bc-938c15f2b9b9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:04.161058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-8bc1c264-b471-4880-872e-2500083cdcbd req-c66f50f8-5cc5-4fd6-b5bc-938c15f2b9b9 service nova] Creating event network-vif-deleted:c5a45800-a3d4-41a3-b81d-2714d69e10a8 for instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 on hv-cinder-xena0 Jan 05 18:16:04.176258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-8bc1c264-b471-4880-872e-2500083cdcbd req-c66f50f8-5cc5-4fd6-b5bc-938c15f2b9b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061809 Jan 05 18:16:04.176971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 572/1096] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:04.656448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:04.657850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:04.664503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:04.665252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:04.666269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:04.666896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:04.707652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:04.708694 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:04.711671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lazy-loading 'fault' on Instance uuid 75a21fb6-f469-48ac-81fb-ed035fec00b8 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:16:04.758495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:04.767747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:04.769555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:04.771157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-deb7943a-ff3b-46dc-b1ef-cd8cd8307994 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 200 len: 1372 microversion: 2.20 time: 0.119084 Jan 05 18:16:04.772215 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 525/1097] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:04 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:05.790878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:05.792059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:05.799960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:05.800801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:05.801789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:05.802449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:05.816692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. Jan 05 18:16:05.817283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:16:05.818135 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e86d9c88-f04e-4061-9551-40bf8c71edda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 404 len: 111 microversion: 2.20 time: 0.032129 Jan 05 18:16:05.818681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 573/1098] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:05 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:16:05.827512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f45d7a44-2d6d-4366-9bfe-48776cc69cb5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '.version_select at 0x7f73447d0430>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:05.929121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f45d7a44-2d6d-4366-9bfe-48776cc69cb5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549106129" status: 204 len: 0 microversion: 2.20 time: 0.105063 Jan 05 18:16:05.942387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 526/1099] 10.222.0.26 () {60 vars in 1261 bytes} [Wed Jan 5 18:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549106129 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 18:16:06.224408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-1dc3ac6b-3b3d-4f1f-9364-ba70dbff500c req-94cea1d2-45d7-4997-9926-9e0628f9d3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8082cfa-4412-4f34-ba49-ff82c3abef30", "tag": "cc53b920-be82-409d-983b-4ac61b3c409d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:06.226461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:06.226461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:16:06.236411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-1dc3ac6b-3b3d-4f1f-9364-ba70dbff500c req-94cea1d2-45d7-4997-9926-9e0628f9d3bd service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:06.237245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-1dc3ac6b-3b3d-4f1f-9364-ba70dbff500c req-94cea1d2-45d7-4997-9926-9e0628f9d3bd service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:06.254313 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-1dc3ac6b-3b3d-4f1f-9364-ba70dbff500c req-94cea1d2-45d7-4997-9926-9e0628f9d3bd service nova] Creating event network-changed:cc53b920-be82-409d-983b-4ac61b3c409d for instance d8082cfa-4412-4f34-ba49-ff82c3abef30 on hv-cinder-xena0 Jan 05 18:16:06.261288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-1dc3ac6b-3b3d-4f1f-9364-ba70dbff500c req-94cea1d2-45d7-4997-9926-9e0628f9d3bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043086 Jan 05 18:16:06.262938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 574/1100] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:06.858668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: .version_select at 0x7f7344718a60>, body: {"keypair": {"name": "tempest-keypair-1163944905"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:06.879345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:06.883338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:07.069846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:07.074173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:07.089783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5b6ed67b-55e1-4bf5-9d2a-4e17f213fc40 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.236734 Jan 05 18:16:07.090625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 527/1101] 10.222.0.26 () {62 vars in 1198 bytes} [Wed Jan 5 18:16:06 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 238 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 05 18:16:09.599651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-419753827", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae9edd83-a753-43bb-9794-9ca1d1f00bcd"}], "security_groups": [{"name": "tempest-securitygroup--442647368"}], "key_name": "tempest-keypair-1163944905", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:09.698149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] validate_networks() for [('ae9edd83-a753-43bb-9794-9ca1d1f00bcd', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:16:10.063062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:16:10.063487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:16:10.063963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:16:10.064372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:16:10.064783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:16:10.073175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:10.073710 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:10.074546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:10.074984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:10.092298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for project b91be5b55b454af7a9f0f161ad064f64. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:10.096318 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Getting quotas for user 122b92afbf58464aba1dcc7a91e9772b and project b91be5b55b454af7a9f0f161ad064f64. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:10.107623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:16:10.110044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:16:10.210110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dc2174c8-778e-4156-bcb6-1e8b094bcc88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.614949 Jan 05 18:16:10.210768 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 575/1102] 10.222.0.26 () {62 vars in 1187 bytes} [Wed Jan 5 18:16:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 05 18:16:10.221130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:10.221731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:10.274109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:10.284877 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:10.286399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:10.287505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8933ac72-064b-42df-aa77-bb362d6c41c0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1281 microversion: 2.20 time: 0.070314 Jan 05 18:16:10.288890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 528/1103] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:10 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:16:11.306195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:11.306799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:11.313400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:11.313842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:11.314625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:11.315059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:11.379337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:11.389286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:11.391290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:11.392402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-930fed4d-aae4-4ea0-b965-bf363b8339e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1285 microversion: 2.20 time: 0.090229 Jan 05 18:16:11.393489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 576/1104] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:11 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:12.351666 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:12.352687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:12.358723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.359173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.359957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.360629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.390610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b7d6a8b2-7226-46fd-997a-6f467f900c27 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042891 Jan 05 18:16:12.391209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 529/1105] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:16:12 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:12.413005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:12.414361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:12.421011 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.421498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.422300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.422736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.452865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:12.453409 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:12.459218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.459660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.460422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.460897 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.483678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:12.487273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:16:12.491548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:12.498898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:12.498898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-95d0e24b-cbd2-4960-ac0e-1a2d17b28de0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1351 microversion: 2.20 time: 0.086697 Jan 05 18:16:12.498898 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 577/1106] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:12 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:12.773165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f3cbd6a4-359b-4970-a34f-f28ccb6ebd57 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 204 len: 0 microversion: 2.1 time: 0.324532 Jan 05 18:16:12.773871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 530/1107] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:16:12 2022] DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:16:12.782183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:12.782790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:12.788393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.788841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.789607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:12.790066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:12.912152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:12.920628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5cb57a1f-2844-4f77-a864-e5baa4961a83 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1671 microversion: 2.1 time: 0.141352 Jan 05 18:16:12.921224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 578/1108] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:12 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1671 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:13.513795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:13.514735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:13.524193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:13.524799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:13.525600 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:13.526051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:13.699422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:13.707270 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:13.708761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:13.709950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9a9ee0fd-b64d-47c9-a280-5f09bfed83fe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.200827 Jan 05 18:16:13.710506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 531/1109] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:13 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:13.777880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-dd96dc30-21c7-40c8-9a6d-094d8beb03f7 req-aaa694d7-5573-4974-9b1d-f6e0431fb31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:13.780344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:13.780344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:16:13.787445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-dd96dc30-21c7-40c8-9a6d-094d8beb03f7 req-aaa694d7-5573-4974-9b1d-f6e0431fb31c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:13.787884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-dd96dc30-21c7-40c8-9a6d-094d8beb03f7 req-aaa694d7-5573-4974-9b1d-f6e0431fb31c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:13.799801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-dd96dc30-21c7-40c8-9a6d-094d8beb03f7 req-aaa694d7-5573-4974-9b1d-f6e0431fb31c service nova] Creating event network-changed:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:16:13.804536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-dd96dc30-21c7-40c8-9a6d-094d8beb03f7 req-aaa694d7-5573-4974-9b1d-f6e0431fb31c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030366 Jan 05 18:16:13.805229 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 579/1110] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:13.938318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:13.938933 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:13.944773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:13.945221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:13.946000 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:13.946462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:14.121605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:14.130633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-40a6e031-4797-4777-92d3-49ce2bde01d7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1671 microversion: 2.1 time: 0.196424 Jan 05 18:16:14.131163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 532/1111] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:13 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:14.728716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:14.729507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:14.736098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:14.736581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:14.737357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:14.737799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:14.860626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:14.869024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:14.870554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:14.871882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-29f1d69c-18ff-4d5f-a3e2-7f31d1e8bd8b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.147439 Jan 05 18:16:14.872538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 580/1112] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:14 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:15.148555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:15.149090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:15.155522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:15.159762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:15.159762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:15.159762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:15.629550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:15.639621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-15f21bde-f1a5-4902-a33d-d2d09ffbe40d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1671 microversion: 2.1 time: 0.494707 Jan 05 18:16:15.641116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 533/1113] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:15 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1671 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:15.819800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-a3dbe435-b8c3-4dd0-bbab-9cf61625ffbe req-1d6e548b-bce2-4e4b-94c2-4c1158866033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43be7c20-103d-483f-99e6-62880b672333", "name": "network-vif-deleted", "tag": "c12cd601-9200-451f-a797-41769529c4ce"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:15.821359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:15.821359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:16:15.828519 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-a3dbe435-b8c3-4dd0-bbab-9cf61625ffbe req-1d6e548b-bce2-4e4b-94c2-4c1158866033 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:15.828899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-a3dbe435-b8c3-4dd0-bbab-9cf61625ffbe req-1d6e548b-bce2-4e4b-94c2-4c1158866033 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:15.839356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-a3dbe435-b8c3-4dd0-bbab-9cf61625ffbe req-1d6e548b-bce2-4e4b-94c2-4c1158866033 service nova] Creating event network-vif-deleted:c12cd601-9200-451f-a797-41769529c4ce for instance 43be7c20-103d-483f-99e6-62880b672333 on hv-cinder-xena0 Jan 05 18:16:15.844345 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-a3dbe435-b8c3-4dd0-bbab-9cf61625ffbe req-1d6e548b-bce2-4e4b-94c2-4c1158866033 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028131 Jan 05 18:16:15.844944 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 581/1114] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:15.905439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:15.906132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:15.920568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:15.921096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:15.921876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:15.922344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:16.046460 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:16.054300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:16.055775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:16.056912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3d960b4d-c2e9-44a3-adf2-2bcaa0f9f646 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.156061 Jan 05 18:16:16.057466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 534/1115] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:15 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:16.657750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:16.659446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:16.665643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:16.666236 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:16.667369 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:16.667801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:16.702449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:16.702903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:16.703359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid 43be7c20-103d-483f-99e6-62880b672333 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:16:16.747038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:16.754870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3f5b9e9d-456e-41ef-b1e3-62bd744b2cc9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 200 len: 1326 microversion: 2.1 time: 0.101763 Jan 05 18:16:16.755438 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 582/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:16 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:17.074256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:17.074864 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:17.081071 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:17.081523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:17.082309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:17.082748 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:17.202717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:17.210216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:17.211692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:17.212775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f876ffa3-5648-4aef-918f-ab1f739153d1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.142204 Jan 05 18:16:17.213324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 535/1117] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:17 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:17.772522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:17.773151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:17.779796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:17.780250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:17.781013 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:17.781448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:17.793962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. Jan 05 18:16:17.795326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:16:17.796130 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1a0b2d7f-0601-447c-80aa-3c30cb3ae10a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 404 len: 111 microversion: 2.1 time: 0.027307 Jan 05 18:16:17.796643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 583/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:17 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:16:17.804480 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4dbb053f-4580-43c1-a609-38c6c6dbd872 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '.version_select at 0x7f73447183a0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:17.910892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4dbb053f-4580-43c1-a609-38c6c6dbd872 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-563862781" status: 202 len: 0 microversion: 2.1 time: 0.109805 Jan 05 18:16:17.911426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 536/1119] 10.222.0.26 () {58 vars in 1217 bytes} [Wed Jan 5 18:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-563862781 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:18.229800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:18.230529 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:18.236352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:18.236796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:18.237555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:18.237988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:18.456347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:18.463987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:18.465469 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:18.466962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f19c20ae-52c6-4fbf-8734-2a7bb51d7c7c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.241095 Jan 05 18:16:18.467520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 584/1120] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:18 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:18.783637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: .version_select at 0x7f7344735b80>, body: {"keypair": {"name": "tempest-keypair-893257788"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:18.801351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:18.805064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:19.262086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:19.268165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'key_pairs'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:19.281616 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c95cf1a7-e03e-4c3d-91e2-1dab3478e0cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.501580 Jan 05 18:16:19.282325 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 537/1121] 10.222.0.26 () {60 vars in 1157 bytes} [Wed Jan 5 18:16:18 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:19.484671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:19.485274 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:19.490957 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:19.491401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:19.492156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:19.492583 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:19.623920 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:19.631613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:19.633110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:19.634304 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-62a6699a-e8b2-41e3-bc94-a16912c2c747 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.153755 Jan 05 18:16:19.635039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 585/1122] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:19 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:20.652664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:20.653265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:20.660494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:20.660943 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:20.661782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:20.662286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:20.865318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:20.872941 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:20.874434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:20.875525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ec8c9d68-76d1-4104-8811-255fc112c1a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.226630 Jan 05 18:16:20.876074 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 538/1123] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:20 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:21.289670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-19e13466-55db-4d29-88cc-c4c13c55cc6b req-ca860f88-1d67-47dd-8a01-3c319c2ddaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "name": "network-vif-plugged", "status": "completed", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:21.294396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:21.294396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:16:21.302105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-19e13466-55db-4d29-88cc-c4c13c55cc6b req-ca860f88-1d67-47dd-8a01-3c319c2ddaab service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:21.302553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-19e13466-55db-4d29-88cc-c4c13c55cc6b req-ca860f88-1d67-47dd-8a01-3c319c2ddaab service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:21.313957 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-19e13466-55db-4d29-88cc-c4c13c55cc6b req-ca860f88-1d67-47dd-8a01-3c319c2ddaab service nova] Creating event network-vif-plugged:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:16:21.318771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-19e13466-55db-4d29-88cc-c4c13c55cc6b req-ca860f88-1d67-47dd-8a01-3c319c2ddaab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034349 Jan 05 18:16:21.319347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 586/1124] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:21.516465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1658848690", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0da28a8c-2ce1-4e0e-9a84-da0477c6194b"}], "security_groups": [{"name": "tempest-securitygroup--318477902"}], "key_name": "tempest-keypair-893257788", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:21.606090 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.network.neutron [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] validate_networks() for [('0da28a8c-2ce1-4e0e-9a84-da0477c6194b', None, None, None, None, None)] {{(pid=116429) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:16:21.893935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:21.895163 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:21.900585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:21.901035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:21.901809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:21.902276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:22.023770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Flavor limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:16:22.024239 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Image limits 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:16:22.024641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Flavor pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:16:22.025046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Image pref 0:0:0 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:16:22.025453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.virt.hardware [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116429) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:16:22.025592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:22.033626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:22.034517 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:22.034959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:22.035085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:22.035755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:22.036159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d7b5b5e4-fccd-4d61-b136-a467cc35bf2f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.146609 Jan 05 18:16:22.036262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:22.036810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 587/1125] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:21 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:16:22.053303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for project a115f4527087421fbd282e13ddea7838. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:16:22.057092 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.quota [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Getting quotas for user a620965de6dd4282ab9f62d66558f8cf and project a115f4527087421fbd282e13ddea7838. Resources: {'cores', 'instances', 'ram'} {{(pid=116429) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:16:22.067463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Going to run 1 instances... {{(pid=116429) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:16:22.069741 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116429) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:16:22.212327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4492b988-bd2e-4a7d-8a14-e49c38ebda8d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.700485 Jan 05 18:16:22.212953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 539/1126] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:16:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:16:22.223648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c15f61b3-c14d-4b2c-a28f-9438fb476bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:22.224501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c15f61b3-c14d-4b2c-a28f-9438fb476bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:22.275449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c15f61b3-c14d-4b2c-a28f-9438fb476bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:22.283101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c15f61b3-c14d-4b2c-a28f-9438fb476bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1237 microversion: 2.1 time: 0.063121 Jan 05 18:16:22.283743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 588/1127] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:22 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:23.054496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:23.055117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:23.061500 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:23.061945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:23.062727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:23.063158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:23.189632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:23.197307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:23.198834 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:23.199926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-02606b5e-3201-43e7-b56d-868db00cf699 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1406 microversion: 2.20 time: 0.149339 Jan 05 18:16:23.200479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 540/1128] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:23 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:23.300546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:23.301131 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:23.306903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:23.307427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:23.308139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:23.308566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:23.367120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:23.375055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-58c535b5-62bf-4ef0-aca3-1f44cf30a27d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1241 microversion: 2.1 time: 0.079431 Jan 05 18:16:23.379640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 589/1129] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:23 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:24.217934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:24.218611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:24.224377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.226641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.226641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.226641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.391305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:24.392026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:24.399242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.399688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.400959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.401409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.435050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:24.443182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:24.444678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:24.446166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aef17eb2-c2bc-4d56-99ca-1b84821e1d07 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1598 microversion: 2.20 time: 0.232296 Jan 05 18:16:24.456220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 541/1130] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:16:24 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1598 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:24.464386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:24.464882 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:24.466404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:24.472222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.472804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.473761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:24.474228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:24.475322 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-307bf6fc-772b-4718-a14a-44a0a9ec78ad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1297 microversion: 2.1 time: 0.087549 Jan 05 18:16:24.481707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 590/1131] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:24 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:24.613931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c6106630-be53-437a-986a-75966820facb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.153890 Jan 05 18:16:24.615110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 542/1132] 10.222.0.26 () {60 vars in 1315 bytes} [Wed Jan 5 18:16:24 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:16:25.494002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:25.495027 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:25.501806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:25.502419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:25.503585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:25.504277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:25.827101 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:25.837889 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-42088dea-cc3c-4dcf-8d10-8ba880ed1bb6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.347962 Jan 05 18:16:25.842360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 591/1133] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:25 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:26.019464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-8dc7558f-5673-43cf-bfe7-b23a542b2c38 req-1456bcd6-7089-47ea-bbb9-6364640ce490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5a3698-19f0-4e99-9fbd-f7d1630b42ab", "tag": "0dacd42b-f70e-4c6a-b252-dfc171bfd08d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:26.021812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:26.021812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:16:26.038465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:26.039696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:26.050862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-8dc7558f-5673-43cf-bfe7-b23a542b2c38 req-1456bcd6-7089-47ea-bbb9-6364640ce490 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.050862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-8dc7558f-5673-43cf-bfe7-b23a542b2c38 req-1456bcd6-7089-47ea-bbb9-6364640ce490 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:26.051104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.051662 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:26.052479 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.052986 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:26.067921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-8dc7558f-5673-43cf-bfe7-b23a542b2c38 req-1456bcd6-7089-47ea-bbb9-6364640ce490 service nova] Creating event network-changed:0dacd42b-f70e-4c6a-b252-dfc171bfd08d for instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab on hv-cinder-xena0 Jan 05 18:16:26.074958 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-8dc7558f-5673-43cf-bfe7-b23a542b2c38 req-1456bcd6-7089-47ea-bbb9-6364640ce490 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061083 Jan 05 18:16:26.080606 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 543/1134] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:26.085737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-bc6af49a-f812-432c-bf33-17f5363a9340 req-2ff6d2f6-e100-49af-a86e-9746bad2f047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:26.087237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:26.087237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:16:26.096245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-bc6af49a-f812-432c-bf33-17f5363a9340 req-2ff6d2f6-e100-49af-a86e-9746bad2f047 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.096716 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-bc6af49a-f812-432c-bf33-17f5363a9340 req-2ff6d2f6-e100-49af-a86e-9746bad2f047 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:26.109323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-bc6af49a-f812-432c-bf33-17f5363a9340 req-2ff6d2f6-e100-49af-a86e-9746bad2f047 service nova] Creating event network-changed:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:16:26.114234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-bc6af49a-f812-432c-bf33-17f5363a9340 req-2ff6d2f6-e100-49af-a86e-9746bad2f047 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032220 Jan 05 18:16:26.114836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 544/1135] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:26.199673 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3f093277-91a8-4684-bf0d-cf0d61b02fe3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.165582 Jan 05 18:16:26.200320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 592/1136] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:26 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:26.856964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:26.857742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:26.865280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.865837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:26.866963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:26.868962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:27.212797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:27.213813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:27.222138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:27.222598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:27.223563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:27.224010 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:27.328047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:27.337299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-01065eb4-79d2-4053-a899-1709bcf3afaa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.485189 Jan 05 18:16:27.338097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 545/1137] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:26 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:27.339965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c53f254e-1704-40b5-a4b5-f0b43a1de8c2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.131994 Jan 05 18:16:27.340613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 593/1138] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:27 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:28.351177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:28.352085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:28.354951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:28.355677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:28.358228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:28.358660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:28.359421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:28.359850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:28.362393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:28.362849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:28.363623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:28.364065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:28.483196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:28.490445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8c6af636-e4b7-4e8c-a6f7-501654f9a401 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.139625 Jan 05 18:16:28.491013 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 594/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:28 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:28.524038 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-580b4b70-c487-4a4f-8936-2ecafd67d395 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.176343 Jan 05 18:16:28.524890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 546/1140] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:28 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:29.507176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:29.507815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:29.513935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:29.515125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:29.515897 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:29.516333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:29.535708 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:29.536704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:29.543109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:29.543563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:29.544332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:29.544771 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:29.636954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:29.644643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f3c09f25-a05f-4751-8abe-f873a80bb9a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.141141 Jan 05 18:16:29.645202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 595/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:29 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:29.704760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-56c253ce-3a16-46e7-ae9b-121c57c70288 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.172928 Jan 05 18:16:29.705445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 547/1142] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:29 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:30.661565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:30.662217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:30.667896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:30.668342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:30.669107 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:30.669537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:30.715408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:30.716390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:30.723692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:30.724140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:30.724904 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:30.725334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:30.793018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:30.800194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-46ebd857-3dcf-409b-97ef-1b34288d3248 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.142280 Jan 05 18:16:30.800759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 596/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:30 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:30.812223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8465646c-52f5-4e55-8d02-13ab50d180b8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.100566 Jan 05 18:16:30.812815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 548/1144] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:30 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:31.817079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:31.817806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:31.823177 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:31.823984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:31.824162 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:31.824432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:31.825202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:31.825645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:31.831448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:31.831891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:31.832652 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:31.833081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:31.944992 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:31.952852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dc13c729-f250-474d-8ae2-2bb3d77655cf tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.139376 Jan 05 18:16:31.953414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 597/1145] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:31 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:31.965061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7a776664-bbca-4b22-bc5e-d93ee85f4b46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.145547 Jan 05 18:16:31.965772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 549/1146] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:31 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:32.969842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:32.970570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:32.976357 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:32.976533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:32.976964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:32.977418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:32.977555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:32.978250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:32.984248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:32.984700 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:32.985474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:32.985912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:33.086964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2a362dd2-f7c1-4e45-8338-4d5452b546a1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.114407 Jan 05 18:16:33.090122 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 550/1147] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:32 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:33.098671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:33.105900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e19d886-d1cc-45fd-a413-fb5328f1793b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.140432 Jan 05 18:16:33.106480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 598/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:32 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:33.314147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-b931a912-0aaa-4e1b-80a4-867d633054f8 req-13ab37f2-ab65-4685-ada1-1e8f2cb3439b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5a3698-19f0-4e99-9fbd-f7d1630b42ab", "name": "network-vif-plugged", "status": "completed", "tag": "0dacd42b-f70e-4c6a-b252-dfc171bfd08d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:33.316114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:33.316114 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:16:33.323094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b931a912-0aaa-4e1b-80a4-867d633054f8 req-13ab37f2-ab65-4685-ada1-1e8f2cb3439b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:33.323540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b931a912-0aaa-4e1b-80a4-867d633054f8 req-13ab37f2-ab65-4685-ada1-1e8f2cb3439b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:33.334808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-b931a912-0aaa-4e1b-80a4-867d633054f8 req-13ab37f2-ab65-4685-ada1-1e8f2cb3439b service nova] Creating event network-vif-plugged:0dacd42b-f70e-4c6a-b252-dfc171bfd08d for instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab on hv-cinder-xena0 Jan 05 18:16:33.339619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-b931a912-0aaa-4e1b-80a4-867d633054f8 req-13ab37f2-ab65-4685-ada1-1e8f2cb3439b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029961 Jan 05 18:16:33.340262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 551/1149] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:16:34.097454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:34.098386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:34.105597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:34.106063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:34.106828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:34.107262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:34.122721 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:34.123418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:34.129385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:34.129829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:34.130636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:34.131069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:34.239786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-934e0f46-164b-4c3c-adf0-237cb9bb020a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.145675 Jan 05 18:16:34.240612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 599/1150] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:34 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:34.256189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:34.263382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-537e3f08-b7e7-4c88-8d40-e175a4f78906 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.144603 Jan 05 18:16:34.263944 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 552/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:34 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:35.252044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:35.253068 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:35.259381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:35.259826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:35.260587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:35.261021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:35.280673 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:35.281383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:35.287556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:35.288006 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:35.288774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:35.289209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:35.356563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d3d73b28-d3cf-46b7-b09d-a5e61b974172 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 14 microversion: 2.20 time: 0.109351 Jan 05 18:16:35.360442 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 600/1152] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:35 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:16:35.416189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:35.419544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a538360b-db38-4cc9-b19c-002f9d5a88dc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1362 microversion: 2.1 time: 0.142682 Jan 05 18:16:35.420103 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 553/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:35 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:36.367995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:36.368996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:36.375593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.376043 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.376818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.377255 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.436630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:36.437264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:36.443224 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.443668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.444474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.444918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.465482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-869b9865-08ff-488c-810a-abc570e8863c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 6451 microversion: 2.20 time: 0.101298 Jan 05 18:16:36.466301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 601/1154] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:36 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 6451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:16:36.564594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:16:36.572005 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-82013a86-92bb-4e04-9d94-2edbe143ea18 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1548 microversion: 2.1 time: 0.139107 Jan 05 18:16:36.572734 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 554/1155] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:16:36 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1548 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:36.588734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:16:36.589314 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:36.596490 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.596940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.597713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:36.598188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:36.677156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-963085af-4180-4187-9be0-1c1cfdc41fe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092340 Jan 05 18:16:36.677757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 602/1156] 10.222.0.26 () {58 vars in 1274 bytes} [Wed Jan 5 18:16:36 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:16:37.477026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:37.477934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:37.483968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:37.484417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:37.485759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:37.486220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:37.586478 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8c049ca0-3c88-4d20-9b15-94ff85681834 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 15025 microversion: 2.20 time: 0.113283 Jan 05 18:16:37.587127 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 555/1157] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:37 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 15025 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:37.641708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:37.642655 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:37.644245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-6687592a-3b1d-4e38-9806-d73aacf6c562 req-a72cafa5-3598-49bd-ab94-d3ff5a9cdbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5a3698-19f0-4e99-9fbd-f7d1630b42ab", "tag": "0dacd42b-f70e-4c6a-b252-dfc171bfd08d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:37.645865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:16:37.645865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:16:37.648637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:37.649145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:37.649932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:37.650402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:37.654061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6687592a-3b1d-4e38-9806-d73aacf6c562 req-a72cafa5-3598-49bd-ab94-d3ff5a9cdbf6 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:37.654440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6687592a-3b1d-4e38-9806-d73aacf6c562 req-a72cafa5-3598-49bd-ab94-d3ff5a9cdbf6 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:37.668824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-6687592a-3b1d-4e38-9806-d73aacf6c562 req-a72cafa5-3598-49bd-ab94-d3ff5a9cdbf6 service nova] Creating event network-changed:0dacd42b-f70e-4c6a-b252-dfc171bfd08d for instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab on hv-cinder-xena0 Jan 05 18:16:37.677566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-6687592a-3b1d-4e38-9806-d73aacf6c562 req-a72cafa5-3598-49bd-ab94-d3ff5a9cdbf6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036904 Jan 05 18:16:37.678188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 556/1158] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:16:37.786670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-69e33eb0-16ae-459e-9423-d58e92774272 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.148787 Jan 05 18:16:37.789578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 603/1159] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:37 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:38.598911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:38.599811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:38.605920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:38.606414 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:38.607188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:38.607621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:38.724860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-757eeaab-8e14-4ba9-b07b-758847a5289f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 18561 microversion: 2.20 time: 0.130402 Jan 05 18:16:38.725496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 557/1160] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:38 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 18561 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:38.797784 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:38.798854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:38.805308 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:38.805752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:38.806560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:38.806986 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:38.899956 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b16a44c0-2467-4f4c-86cc-0b040794bd4d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.106656 Jan 05 18:16:38.900846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 604/1161] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:38 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:39.736871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:39.737849 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:39.744472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:39.744959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:39.745718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:39.746182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:39.837330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4b648e61-72f5-4243-a04b-b1c7e85f3a3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 20675 microversion: 2.20 time: 0.104467 Jan 05 18:16:39.838123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 558/1162] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:39 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 20675 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:39.911097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:39.912125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:39.918544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:39.918995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:39.919827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:39.920286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:40.021743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-aad4739b-d8b6-466b-8cec-b18ed122caad tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.114566 Jan 05 18:16:40.022430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 605/1163] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:39 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:40.849183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:40.850148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:40.856746 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:40.857187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:40.857952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:40.858520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:40.948695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bcf30ced-349a-493e-b62e-09f60b5def29 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 22869 microversion: 2.20 time: 0.103697 Jan 05 18:16:40.949314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 559/1164] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:40 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 22869 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:16:41.032852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:41.033848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:41.040224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:41.040672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:41.041437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:41.041873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:41.120988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ff3454dd-1a90-46c1-82c0-383a4e8c0f34 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.091906 Jan 05 18:16:41.121719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 606/1165] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:41 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:41.962337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:41.963339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:41.970123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:41.970569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:41.971330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:41.971757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:42.071192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-245a5e86-ce55-4c97-87dc-d1e45787f608 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 23803 microversion: 2.20 time: 0.114225 Jan 05 18:16:42.071837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 560/1166] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:41 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 23803 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:42.132797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:42.133786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:42.140288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:42.141418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:42.142209 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:42.142639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:42.230750 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2a0cda2e-d3ef-4277-a2e2-e7b914553647 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.101364 Jan 05 18:16:42.231309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 607/1167] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:42 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:43.083721 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:43.084720 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:43.091968 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:43.092690 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:43.093474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:43.093949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:43.195821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f4b2e219-233d-406f-8fdd-2957628e1740 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 25707 microversion: 2.20 time: 0.116023 Jan 05 18:16:43.196476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 561/1168] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:43 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 25707 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:43.241575 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:43.242591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:43.248899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:43.249346 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:43.251234 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:43.251679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:43.331811 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-875ae535-3b18-4b1f-a9ab-136c17ee058b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.094135 Jan 05 18:16:43.332554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 608/1169] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:43 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:44.208441 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:44.209432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:44.215847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:44.216305 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:44.217070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:44.217505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:44.327892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ff4f7a0b-9299-470b-a77a-e494c0da7217 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 27045 microversion: 2.20 time: 0.123969 Jan 05 18:16:44.330447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 562/1170] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:44 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 27045 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:44.342963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:44.343983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:44.350405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:44.350855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:44.351621 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:44.352055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:44.439317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fdc3ee4e-c8dc-4445-8fcb-c35b05a267a3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.099706 Jan 05 18:16:44.440398 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 609/1171] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:44 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:45.340483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:45.341484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:45.348357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:45.348805 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:45.349566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:45.350002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:45.448143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-13ac26eb-12c1-4f2e-b6a1-af8fd3541c31 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 27670 microversion: 2.20 time: 0.111594 Jan 05 18:16:45.449008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 563/1172] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:45 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 27670 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:45.451156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:45.452156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:45.459224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:45.459671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:45.460436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:45.460869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:45.545863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-079c70b3-a30d-49eb-8f2e-76b9e47ed179 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.098526 Jan 05 18:16:45.546564 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 610/1173] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:45 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 18:16:46.460423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:46.461453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:46.467916 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:46.468379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:46.469239 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:46.469686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:46.557174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:46.558215 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:46.564862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:46.565312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:46.566114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:46.566551 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:46.579957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-187d19d6-c643-40c1-b0f7-88971196905c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28081 microversion: 2.20 time: 0.123571 Jan 05 18:16:46.580670 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 564/1174] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:46 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28081 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:16:46.658928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c741bf90-7da2-42bf-aa6d-b63cd1f4abef tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 14 microversion: 2.1 time: 0.105485 Jan 05 18:16:46.659568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 611/1175] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:46 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:16:47.592596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:47.593579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:47.600964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:47.601419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:47.602209 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:47.602643 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:47.670350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:47.671375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:47.678188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:47.678645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:47.679414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:47.679855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:47.723823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b4deeafa-1f6f-44f2-8d1a-cff272fc8316 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.135074 Jan 05 18:16:47.724467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 565/1176] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:47 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:47.785416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7c5c38ca-aee7-4119-955c-01c0440d0f4e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 2235 microversion: 2.1 time: 0.118966 Jan 05 18:16:47.786046 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 612/1177] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:47 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 2235 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:16:48.735195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:48.736248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:48.742701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:48.743148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:48.743912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:48.744347 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:48.834181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e9371323-d67b-4186-9c20-36ad95e13745 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.102789 Jan 05 18:16:48.836790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 566/1178] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:48 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:48.940592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:48.941577 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:48.947363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:48.947807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:48.948562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:48.948991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:49.035166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6b66edb9-0b1a-4473-9458-2264d9ac0c1c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 15025 microversion: 2.1 time: 0.242495 Jan 05 18:16:49.035764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 613/1179] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:48 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 15025 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:16:49.857601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:49.858569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:49.865848 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:49.866338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:49.867112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:49.867551 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:49.975727 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3feab598-7d0f-49b8-b58c-2b0addb9093f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.122473 Jan 05 18:16:49.976353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 567/1180] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:49 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:50.046805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:50.047808 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:50.054300 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:50.054781 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:50.055547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:50.056009 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:50.140835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-76f869af-eef6-461d-97d8-0751aa4656e1 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 18561 microversion: 2.1 time: 0.097874 Jan 05 18:16:50.141365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 614/1181] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:50 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 18561 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:50.988599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:50.989603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:50.996123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:50.996574 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:50.997338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:50.997775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:51.093454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-12c343e9-cf89-4d1e-92f5-3c673aa51065 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.109379 Jan 05 18:16:51.094101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 568/1182] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:50 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:16:51.153316 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:51.154337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:51.161608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:51.162079 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:51.162845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:51.163279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:51.258988 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d966bfb8-b95a-453c-923a-026e7a777550 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 19342 microversion: 2.1 time: 0.109452 Jan 05 18:16:51.259570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 615/1183] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:51 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 19342 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:52.106381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:52.107397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:52.114454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:52.114900 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:52.115677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:52.116116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:52.220237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8e4a7325-0a8a-4aac-be9f-577d887e226c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.118056 Jan 05 18:16:52.220891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 569/1184] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:52 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:52.269949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:52.270985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:52.277335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:52.277790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:52.278596 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:52.279038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:52.372307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-14869084-11a2-4eaa-b2f4-66a1f2d2e537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 22212 microversion: 2.1 time: 0.106220 Jan 05 18:16:52.372887 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 616/1185] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:52 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 22212 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:53.232584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:53.233611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:53.240182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:53.240631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:53.241396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:53.241830 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:53.334428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c678317f-3bdb-4b05-9c14-574daa19f966 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.105951 Jan 05 18:16:53.335063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 570/1186] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:53 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:53.384330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:53.385451 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:53.392456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:53.392875 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:53.393642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:53.394102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:53.487618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fed5a0d2-47c5-4c4d-8665-84ed66f75274 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 23977 microversion: 2.1 time: 0.107106 Jan 05 18:16:53.488158 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 617/1187] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:53 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 23977 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:54.347320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:54.348345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:54.354966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:54.355409 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:54.356164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:54.356590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:54.455282 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f1ecd748-106f-4d95-b779-ba6eceb2e77d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.111913 Jan 05 18:16:54.455898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 571/1188] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:54 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:54.498681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:54.499678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:54.506034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:54.506484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:54.507241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:54.507668 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:54.602850 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-68dd2774-4ed7-4036-a097-a73ec0c5f705 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 25659 microversion: 2.1 time: 0.107889 Jan 05 18:16:54.603656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 618/1189] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:54 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 25659 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:55.467176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:55.468173 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:55.474735 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:55.475181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:55.475946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:55.476379 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:55.568677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8057ae2f-2908-4ede-a795-bfa4d7d4e0ce tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.105374 Jan 05 18:16:55.569344 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 572/1190] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:55 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:16:55.614704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:55.615706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:55.621757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:55.622258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:55.623023 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:55.623456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:55.724539 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a20b1b54-c91d-4f0d-8e57-5944e68fbdca tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 27081 microversion: 2.1 time: 0.114338 Jan 05 18:16:55.725464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 619/1191] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:55 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 27081 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:56.580989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:56.581899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:56.588220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:56.588695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:56.589457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:56.589894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:56.677736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e51887ac-dca9-4119-b83e-35ec89b54e65 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.101342 Jan 05 18:16:56.678482 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 573/1192] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:56 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:56.737803 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:56.738834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:56.745174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:56.745620 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:56.746418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:56.746858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:56.853800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-135b7fec-1340-4706-87d4-090feeeef16e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 27757 microversion: 2.1 time: 0.120480 Jan 05 18:16:56.854670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 620/1193] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:56 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 27757 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:57.689995 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:57.691050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:57.697540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:57.697988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:57.698788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:57.699228 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:57.789552 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e5656e78-3870-46d4-9b59-677dae64b2db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.103529 Jan 05 18:16:57.790300 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 574/1194] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:57 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:57.865778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:57.866771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:57.873099 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:57.873548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:57.874353 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:57.874787 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:57.976199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e4133433-3014-4b0b-b6a3-59922c79586d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28079 microversion: 2.1 time: 0.114295 Jan 05 18:16:57.976749 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 621/1195] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:57 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28079 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:16:58.802265 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:58.803335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:58.809668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:58.810133 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:58.810896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:58.811324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:58.904704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-97bc3b7c-5be3-4b40-a0ae-3cbee23ccec4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.107068 Jan 05 18:16:58.905248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 575/1196] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:58 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:16:58.987643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:58.988646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:58.994969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:58.995413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:58.996172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:58.996602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:59.086044 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d7743742-a773-46a4-b9f2-241cd841206f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.102455 Jan 05 18:16:59.086878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 622/1197] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:16:58 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:16:59.916762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:16:59.917750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:16:59.924129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:59.925059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:16:59.929394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:16:59.929394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:00.026298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ca0a723e-25f1-42b2-8410-9e8f4c151e3e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.113558 Jan 05 18:17:00.026935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 576/1198] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:16:59 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:00.098386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:00.099412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:00.105973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:00.106450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:00.107206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:00.107638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:00.204126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5d455d4a-5a6f-4b7d-a565-40a6c0532300 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.110086 Jan 05 18:17:00.204676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 623/1199] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:00 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:01.038896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:01.039891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:01.046258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:01.046709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:01.047474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:01.047909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:01.129368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d17177f2-04b9-4fa3-b37a-eb7044fa4d6a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.094886 Jan 05 18:17:01.130008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 577/1200] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:01 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:01.216329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:01.217454 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:01.224242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:01.224701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:01.225488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:01.225926 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:01.320868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9e7db35f-c531-4840-8e49-295a7a4d3dd5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.108365 Jan 05 18:17:01.321856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 624/1201] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:01 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:02.141415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:02.142370 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:02.149251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:02.149689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:02.150485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:02.150914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:02.235524 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8d8f28c3-52a4-4ffb-afca-98c89b14b759 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.098098 Jan 05 18:17:02.236187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 578/1202] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:02 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:02.334523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:02.335195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:02.341536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:02.341989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:02.342788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:02.343226 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:02.427522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5c7d33ab-698f-456f-929e-f82884f34bfc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.098234 Jan 05 18:17:02.428452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 625/1203] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:02 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:03.248317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:03.249317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:03.255713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:03.256165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:03.256932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:03.257367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:03.337499 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-28496a3c-c8fe-429b-a50a-1ca01bcc8384 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28196 microversion: 2.20 time: 0.093156 Jan 05 18:17:03.338148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 579/1204] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:03 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28196 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:03.439287 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:03.440281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:03.446588 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:03.447026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:03.447786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:03.448216 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:03.529571 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7cac4497-95cd-45f7-aab9-44344d8df57e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.094049 Jan 05 18:17:03.530180 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 626/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:03 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:04.349831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:04.350969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:04.357543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:04.357978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:04.358764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:04.359190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:04.452041 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c77c0219-500a-400d-ab70-5e45a6d50768 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28323 microversion: 2.20 time: 0.106663 Jan 05 18:17:04.452697 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 580/1206] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:04 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28323 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:04.541157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:04.542190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:04.548547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:04.549003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:04.550576 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:04.551015 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:04.640801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ad8acaaa-afc1-458c-8db2-e9e2fd969fb7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.103518 Jan 05 18:17:04.641469 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 627/1207] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:04 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:05.464089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:05.465096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:05.471509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:05.471951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:05.472705 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:05.473134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:05.576927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-808eb260-93a4-47a4-a680-2856d0fffd93 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28487 microversion: 2.20 time: 0.116692 Jan 05 18:17:05.577625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 581/1208] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:05 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28487 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:05.652554 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:05.653552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:05.660367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:05.660817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:05.661587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:05.662039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:05.743445 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e2e2cafe-f763-45aa-a211-6855f59d84df tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.094689 Jan 05 18:17:05.743997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 628/1209] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:05 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:06.598283 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:06.599196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:06.606040 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:06.606498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:06.607264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:06.607700 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:06.714609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0c88dc67-2900-4d5b-b1ac-853b94c22dd6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28538 microversion: 2.20 time: 0.120869 Jan 05 18:17:06.715263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 582/1210] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:06 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28538 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:06.755902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:06.756955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:06.763347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:06.763795 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:06.764562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:06.765108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:06.849704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7f6abf55-9dc1-4561-853a-55202b5c8ac7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.098611 Jan 05 18:17:06.850531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 629/1211] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:06 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:07.727416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:07.728665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:07.734979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:07.735432 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:07.736193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:07.736631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:07.809220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:17:07.809745 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:17:07.842917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2b72f8a2-8c8e-4731-80f6-baa35993d028 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.119415 Jan 05 18:17:07.843561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 583/1212] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:07 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:07.861482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:07.863161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:07.869477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:07.869863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:07.870647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:07.871080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:07.952058 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1f7d7852-5142-45dd-8eb5-ecd71ca04bf7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.094405 Jan 05 18:17:07.952657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 630/1213] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:07 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:08.854444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:08.855484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:08.861879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:08.862520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:08.863474 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:08.863914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:08.944574 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-10144dfd-64db-48ea-add8-4551186ecbe7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.094356 Jan 05 18:17:08.945198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 584/1214] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:08 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:08.963869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:08.964853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:08.971408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:08.972533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:08.973298 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:08.973726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:09.055149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f779093a-a6a6-4b3b-bdf1-d1df677f60f6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.095182 Jan 05 18:17:09.055753 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 631/1215] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:08 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:09.957509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:09.958634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:09.965124 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:09.965566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:09.966364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:09.966797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.061448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-21f05990-6794-4e5c-9735-3aaf362c4e02 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.107205 Jan 05 18:17:10.065038 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 585/1216] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:09 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:10.068325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:10.069356 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:10.076402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.076855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.077651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.078112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.167002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5e9fe71f-72e4-4e29-a206-0674b210854b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.103407 Jan 05 18:17:10.167699 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 632/1217] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:10 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:10.272927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:10.273797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:10.275455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-2ee4545c-e715-4b96-b305-522ab47b4357 req-d747b06d-142d-4229-8a4b-8332f787dbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:10.277048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:17:10.277048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:17:10.280171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.280855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.281640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.282100 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.286260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-2ee4545c-e715-4b96-b305-522ab47b4357 req-d747b06d-142d-4229-8a4b-8332f787dbb5 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.286985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-2ee4545c-e715-4b96-b305-522ab47b4357 req-d747b06d-142d-4229-8a4b-8332f787dbb5 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.298199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-2ee4545c-e715-4b96-b305-522ab47b4357 req-d747b06d-142d-4229-8a4b-8332f787dbb5 service nova] Creating event network-changed:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:17:10.303764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-2ee4545c-e715-4b96-b305-522ab47b4357 req-d747b06d-142d-4229-8a4b-8332f787dbb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Jan 05 18:17:10.304738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 633/1218] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:17:10.309785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:17:10.639913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0056a45b-e1d3-44bc-a1ca-4c5391ef714a tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 204 len: 0 microversion: 2.1 time: 0.371504 Jan 05 18:17:10.640515 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 586/1219] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:17:10 2022] DELETE /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:17:10.649474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:10.650327 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:10.656268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.656708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.657466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:10.658103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:10.848573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:17:10.856858 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f1b5f989-3ddd-49bd-bf21-0d95af138195 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1567 microversion: 2.1 time: 0.211297 Jan 05 18:17:10.858915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 634/1220] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:17:10 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:17:11.071978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:11.073018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:11.078907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.079349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:11.080113 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.080540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:11.166485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-700b0664-596e-41df-b826-872f59288137 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.098363 Jan 05 18:17:11.167366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 587/1221] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:11 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:11.178716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:11.179682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:11.185503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.185895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:11.186703 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.187138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:11.277813 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-97324914-b283-41bc-99ec-81f5af4a0021 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.102893 Jan 05 18:17:11.278592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 635/1222] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:11 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:11.875343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:11.875948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:11.883054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.884902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:11.884902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:11.884902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:12.051505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:17:12.058639 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fd089d90-2494-48c9-af02-f4950f665d8f tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1448 microversion: 2.1 time: 0.187377 Jan 05 18:17:12.059194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 588/1223] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:17:11 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1448 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:17:12.179264 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:12.180281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:12.186243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:12.186689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:12.187446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:12.187877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:12.289190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:12.290185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:12.296152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:12.296601 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:12.297369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:12.297833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:12.327038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e7f0491e-ffa4-47ee-8656-aa9b9eae1ac7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.152447 Jan 05 18:17:12.327682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 636/1224] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:12 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:12.384717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-846b5168-e9dd-4e46-840e-9b69e5b7b694 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.099060 Jan 05 18:17:12.385337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 589/1225] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:12 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:13.076464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:13.077535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:13.083791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.084231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.084996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.085425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.204018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:17:13.212653 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e9d38c83-1d30-4a6a-8c45-a10340b733ed tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1448 microversion: 2.1 time: 0.140176 Jan 05 18:17:13.213537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 637/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:17:13 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1448 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:17:13.308464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-580993b8-9b3f-4928-97f4-8803c2f5eb88 req-e00e32b7-d330-49d9-9e24-8ffd108f29ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5647338f-7bc8-43fb-b562-0ddc5523a6a2", "name": "network-vif-deleted", "tag": "ffc7dfab-43e2-40de-9a25-49ae23ebf48d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:13.309926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:17:13.309926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:17:13.317825 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-580993b8-9b3f-4928-97f4-8803c2f5eb88 req-e00e32b7-d330-49d9-9e24-8ffd108f29ce service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.318292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-580993b8-9b3f-4928-97f4-8803c2f5eb88 req-e00e32b7-d330-49d9-9e24-8ffd108f29ce service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.329147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-580993b8-9b3f-4928-97f4-8803c2f5eb88 req-e00e32b7-d330-49d9-9e24-8ffd108f29ce service nova] Creating event network-vif-deleted:ffc7dfab-43e2-40de-9a25-49ae23ebf48d for instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 on hv-cinder-xena0 Jan 05 18:17:13.334977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-580993b8-9b3f-4928-97f4-8803c2f5eb88 req-e00e32b7-d330-49d9-9e24-8ffd108f29ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030361 Jan 05 18:17:13.335628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 590/1227] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:17:13.338181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:13.339087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:13.344805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.345245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.346001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.347134 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.397283 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:13.398337 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:13.404381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.406144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.406144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:13.406144 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:13.439308 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-333d6d98-69dd-4cc2-a44e-902e7096f67a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.104733 Jan 05 18:17:13.440393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 638/1228] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:13 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:13.511112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-482a87b7-76e3-4014-86bb-d9c522926e08 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.118180 Jan 05 18:17:13.514577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 591/1229] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:13 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:14.230608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:14.231292 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:14.238332 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.238853 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.239615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.240040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.268989 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.269427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.269872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lazy-loading 'fault' on Instance uuid 5647338f-7bc8-43fb-b562-0ddc5523a6a2 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:17:14.312543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e462cf75ac4791a7a11a8a20754b59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77afa1dabebf479f8d59f54a3d9fad5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:17:14.319884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-05690814-110f-4662-acfc-74e385a96c8c tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 200 len: 1224 microversion: 2.1 time: 0.093610 Jan 05 18:17:14.320446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 639/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:17:14 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:17:14.451631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:14.452635 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:14.459089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.459670 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.460448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.460888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.523169 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:14.524088 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:14.529728 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.530213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.530981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:14.531416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:14.544954 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-16c54647-7194-4519-b10e-649407bf1e03 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.097310 Jan 05 18:17:14.548898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 592/1231] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:14 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:14.629030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1888686e-dbb4-4338-b48a-1abed799dfe6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.109459 Jan 05 18:17:14.631756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 640/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:14 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:15.336155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:15.336840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] [instance: 5647338f-7bc8-43fb-b562-0ddc5523a6a2] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:15.343255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.343702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.344466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.344896 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.358597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] HTTP exception thrown: Instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 could not be found. Jan 05 18:17:15.359179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Returning 404 to user: Instance 5647338f-7bc8-43fb-b562-0ddc5523a6a2 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:17:15.359982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ec5e2665-6b24-4e14-982e-216ba66068eb tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2" status: 404 len: 111 microversion: 2.1 time: 0.027850 Jan 05 18:17:15.360493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 593/1233] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:17:15 2022] GET /compute/v2.1/servers/5647338f-7bc8-43fb-b562-0ddc5523a6a2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:17:15.557744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:15.558762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:15.565307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.565760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.566565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.567000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.640730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:15.642089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:15.648199 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.648703 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.649479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:15.649917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:15.652024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fecabc56-da7b-4c72-b075-fe6bb52467be tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.098393 Jan 05 18:17:15.652676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 641/1234] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:15 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:15.678848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ae9f0b04-9449-4005-b8ba-343abc308488 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] Calling method '.version_select at 0x7f73498641f0>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:17:15.730997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-75acc106-84de-4289-a931-1ebde75dc560 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.093741 Jan 05 18:17:15.731645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 594/1235] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:15 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:15.773223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ae9f0b04-9449-4005-b8ba-343abc308488 tempest-TestShelveInstance-602942934 tempest-TestShelveInstance-602942934-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-591133659" status: 202 len: 0 microversion: 2.1 time: 0.099056 Jan 05 18:17:15.773782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 642/1236] 10.222.0.26 () {58 vars in 1250 bytes} [Wed Jan 5 18:17:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-591133659 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:16.664880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:16.665879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:16.672493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:16.672941 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:16.673713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:16.674179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:16.743941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:16.744872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:16.751418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:16.751866 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:16.753247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:16.753783 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:16.766356 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0863b68b-143c-44e4-bb8c-63f1dc6737d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.105327 Jan 05 18:17:16.767057 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 595/1237] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:16 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:16.837305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f84d2c2d-530d-424c-b643-465004d6290a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.097383 Jan 05 18:17:16.841208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 643/1238] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:16 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:17.779051 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:17.780044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:17.787294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:17.787737 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:17.788512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:17.788952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:17.850340 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:17.851389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:17.858126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:17.858593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:17.859361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:17.859796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:17.892137 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a3aadf3d-4ffa-453c-af73-668987eedada tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.116794 Jan 05 18:17:17.892843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 596/1239] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:17 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:17.964087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bca2ef5e-feac-4ba6-a5fa-bd27bae0b660 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.118706 Jan 05 18:17:17.965299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 644/1240] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:17 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:18.905219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:18.905768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:18.911817 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:18.912261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:18.913038 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:18.913475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:18.976852 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:18.977869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:18.984437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:18.984896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:18.985675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:18.986136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:19.001058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f150da95-101e-44ee-97e6-5c40948eeb54 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.100633 Jan 05 18:17:19.001711 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 597/1241] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:18 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:19.084403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d7ae90b1-2293-4f34-a97c-451ddf241c2d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.111603 Jan 05 18:17:19.085057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 645/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:18 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:20.014399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:20.015399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:20.022579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:20.023031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:20.023808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:20.024241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:20.096976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:20.097997 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:20.104538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:20.104985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:20.105749 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:20.106214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:20.120566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-87e25270-e1a5-4602-8b32-ee40979dba1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.110136 Jan 05 18:17:20.121382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 598/1243] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:20 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:20.184885 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-91e351bc-1c88-4cfb-b6d9-af91baebf7ae tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.092348 Jan 05 18:17:20.188684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 646/1244] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:20 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:21.133183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:21.134970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:21.141368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:21.141818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:21.142621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:21.143062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:21.197142 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:21.198266 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:21.204820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:21.205339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:21.206472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:21.206979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:21.243439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-91860f51-871f-489e-a01a-aa49d1aeabf7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.114111 Jan 05 18:17:21.244810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 599/1245] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:21 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:21.304966 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-57488992-bc6c-498f-ad44-056f8cf5c933 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28180 microversion: 2.1 time: 0.111625 Jan 05 18:17:21.308950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 647/1246] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:21 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28180 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:22.255208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:22.256226 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:22.262564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:22.263158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:22.263923 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:22.264352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:22.316800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:22.318657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:22.325120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:22.325749 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:22.326547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:22.326978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:22.362993 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c17fdda0-0f22-4c56-8e2d-2c8c6634e0ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.111498 Jan 05 18:17:22.364346 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 600/1247] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:22 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:22.426553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d7235380-f3cd-4785-ad00-95f9180d9f7a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28471 microversion: 2.1 time: 0.112118 Jan 05 18:17:22.426553 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 648/1248] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:22 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28471 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:23.375434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:23.376463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:23.383594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:23.384042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:23.384803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:23.385231 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:23.436825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:23.437876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:23.445227 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:23.445682 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:23.446480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:23.446918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:23.478753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2608d350-4474-414a-b387-65b12d3c44db tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.107040 Jan 05 18:17:23.479644 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 601/1249] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:23 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:23.545076 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-15e42d01-5ce5-4221-a05f-36e516d8a537 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28471 microversion: 2.1 time: 0.111870 Jan 05 18:17:23.546752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 649/1250] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:23 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:24.489869 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:24.490880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:24.497148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:24.497591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:24.498377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:24.498806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:24.557613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:24.558683 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:24.565462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:24.567323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:24.567323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:24.567323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:24.589035 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-87492e04-7ae2-41b4-a32b-ba6cc302ae35 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.102946 Jan 05 18:17:24.589679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 602/1251] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:24 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:24.666724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c07e9341-fa3f-4291-957c-1bde57660c14 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.112829 Jan 05 18:17:24.667431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 650/1252] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:24 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:25.605764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:25.606776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:25.614143 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:25.614592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:25.615351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:25.615777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:25.679337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:25.680331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:25.686735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:25.687182 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:25.687956 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:25.688391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:25.710183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a5c64b87-b29d-42ae-b78c-63d92a05bb20 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.108506 Jan 05 18:17:25.714197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 603/1253] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:25 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:25.784305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3adcc16b-4c8c-4424-8b57-f8e62fcb2ced tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.108049 Jan 05 18:17:25.784975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 651/1254] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:25 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:17:26.723163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:26.724148 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:26.730772 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:26.731217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:26.731977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:26.732411 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:26.796834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:26.797863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:26.804328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:26.804780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:26.805549 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:26.805987 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:26.816355 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-31187f6a-2d8b-4d44-97df-8ee0eaa8f9bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.097757 Jan 05 18:17:26.817221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 604/1255] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:26 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:26.894973 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-877ed24c-2b48-43dd-95bd-ad9094727135 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.101897 Jan 05 18:17:26.895603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 652/1256] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:26 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:27.828539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:27.829556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:27.836125 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:27.836565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:27.837321 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:27.837751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:27.907114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:27.908038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:27.915297 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:27.915751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:27.916617 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:27.917160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:27.944005 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-359e6d10-52fb-43a8-81cc-d58c1b36866d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.119298 Jan 05 18:17:27.944645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 605/1257] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:27 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:27.998334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1c74359a-0386-443e-9cf9-3212a595cdbd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095141 Jan 05 18:17:27.998955 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 653/1258] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:27 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:28.956506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:28.957507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:28.963880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:28.964324 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:28.965089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:28.965522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:29.010075 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:29.011060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:29.017355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:29.018184 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:29.018786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:29.019221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:29.056402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-76220b7b-9e27-465f-8ed5-31a67ddec20b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.104116 Jan 05 18:17:29.057048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 606/1259] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:28 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:29.117824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-401ae834-5058-4a1b-90b7-2b561746e52b tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.111536 Jan 05 18:17:29.118496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 654/1260] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:29 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:30.068291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:30.069279 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:30.075602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:30.076066 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:30.076802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:30.077251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:30.129476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:30.130476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:30.136819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:30.137272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:30.138068 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:30.138510 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:30.165649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-07a8b6a3-ef85-4386-8ba6-e6bd429cb088 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.101707 Jan 05 18:17:30.166336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 607/1261] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:30 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:30.219975 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-65f8a343-ba5d-4a83-aed4-59326bdba724 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095062 Jan 05 18:17:30.220595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 655/1262] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:30 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:31.177788 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:31.178802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:31.185113 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:31.186196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:31.186331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:31.186751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:31.231869 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:31.232923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:31.239472 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:31.239931 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:31.240731 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:31.241171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:31.269430 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7b588a6f-e740-4958-9639-2d6521274486 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.095559 Jan 05 18:17:31.270089 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 608/1263] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:31 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:31.320060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9c8554a9-7bcd-4314-86e6-964cf4e0a1b6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.092319 Jan 05 18:17:31.320684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 656/1264] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:31 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:32.281386 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:32.282436 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:32.289412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:32.289860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:32.290658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:32.291264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:32.331692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:32.332690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:32.339083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:32.339530 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:32.340295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:32.340734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:32.377750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4c87cadc-b653-484c-b1ae-aa39a0b978ea tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.100200 Jan 05 18:17:32.378592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 609/1265] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:32 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:32.434801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-27eae137-2d58-4181-97fa-89d50358505c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.107158 Jan 05 18:17:32.435464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 657/1266] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:32 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:33.389892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:33.390953 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:33.397512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:33.397964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:33.398902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:33.399343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:33.447049 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:33.448039 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:33.454409 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:33.454859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:33.455945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:33.456388 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:33.509096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aff55d9b-860e-4cf9-919d-a30fb2ed09c3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.123103 Jan 05 18:17:33.509747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 610/1267] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:33 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:33.557667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7f8b3383-77fb-4f81-89b8-ceb42c947836 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.114454 Jan 05 18:17:33.558335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 658/1268] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:33 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:34.521659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:34.522671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:34.529048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:34.529486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:34.530280 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:34.530712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:34.571433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:34.572433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:34.578776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:34.579225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:34.581155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:34.581600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:34.613321 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-34fafda2-079b-4de1-b671-cef40e868209 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.095984 Jan 05 18:17:34.614257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 611/1269] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:34 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:34.667857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5280bdd1-6d47-4e25-9e44-1b35d99f6565 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.100234 Jan 05 18:17:34.668679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 659/1270] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:34 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:35.625348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:35.626404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:35.633577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:35.634053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:35.634829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:35.635289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:35.680168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:35.681159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:35.687585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:35.688030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:35.688806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:35.689450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:35.722663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b5e2e87f-d744-44c8-8d3b-a8092ee05336 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.101271 Jan 05 18:17:35.723407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 612/1271] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:35 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:35.776672 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-88c1a843-6087-4a6a-8da4-ee80fcc3472c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.100361 Jan 05 18:17:35.777305 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 660/1272] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:35 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:36.734967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:36.735966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:36.742724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:36.743179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:36.743951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:36.744392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:36.788421 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:36.789408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:36.795797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:36.796251 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:36.797015 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:36.797450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:36.840428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c08d0058-e822-4709-a2e9-eccbe9d679e1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.109420 Jan 05 18:17:36.841163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 613/1273] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:36 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:36.903232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a8037ca1-053a-4c7c-aa4c-d6d9e8020999 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.118590 Jan 05 18:17:36.903810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 661/1274] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:36 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:37.852814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:37.854085 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:37.860517 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:37.861563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:37.862361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:37.862798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:37.915219 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:37.916207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:37.922532 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:37.923003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:37.924350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:37.924867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:37.944611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-28c66282-da77-44e8-82fc-8cbc939974e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.095672 Jan 05 18:17:37.946277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 614/1275] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:37 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:38.005089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1eae2d88-a1a2-41d8-b5ef-a85222923262 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.093691 Jan 05 18:17:38.005730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 662/1276] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:37 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:38.957404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:38.958429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:38.964802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:38.965247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:38.966032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:38.966471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:39.016948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:39.018743 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:39.026102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:39.026102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:39.026321 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:39.028827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:39.053107 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cceebac9-85c3-4bc5-9b8b-7d02f6471636 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.100061 Jan 05 18:17:39.053866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 615/1277] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:38 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:39.106927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9f2057dc-88bc-415f-9e45-a04e83a1702c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.093785 Jan 05 18:17:39.107747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 663/1278] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:39 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:40.065704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:40.066739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:40.073131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:40.073579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:40.074371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:40.074812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:40.118612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:40.119611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:40.125916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:40.126406 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:40.127824 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:40.128271 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:40.157026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9ff5ed45-b585-4196-bf2c-2c96691d1bda tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.095762 Jan 05 18:17:40.157686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 616/1279] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:40 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:40.213734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8478a025-7910-46eb-88c1-e46cb0bdbbe9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.098888 Jan 05 18:17:40.214396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 664/1280] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:40 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:41.169273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:41.170295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:41.177190 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:41.177631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:41.178413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:41.178843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:41.225509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:41.226650 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:41.234372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:41.235476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:41.235637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:41.236074 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:41.279906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-114ab35d-dc74-44bf-9cff-e868220f41e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.114542 Jan 05 18:17:41.280559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 617/1281] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:41 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:41.329020 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9b97b77a-5aed-4a60-822c-d337ebe85463 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.107791 Jan 05 18:17:41.329914 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 665/1282] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:41 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:42.292172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:42.293222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:42.299618 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:42.300668 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:42.301430 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:42.301865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:42.340966 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:42.341947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:42.348253 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:42.348705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:42.349468 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:42.349901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:42.392818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-340ed72a-6900-487c-8246-a39a81810536 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.104535 Jan 05 18:17:42.393479 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 618/1283] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:42 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:42.450444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e743fa2a-69f7-44a8-a8bf-097bb2333fb5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.113235 Jan 05 18:17:42.451077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 666/1284] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:42 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:43.405630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:43.406685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:43.413789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:43.414273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:43.415036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:43.415471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:43.462688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:43.463676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:43.469937 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:43.470414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:43.471167 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:43.474122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:43.496677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ca45f4c7-8773-42ad-aa60-209b6e7ba2b5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.094971 Jan 05 18:17:43.498271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 619/1285] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:43 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:43.559486 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-81ab0d78-3fe3-4a4d-8d50-b3cfde5a3d47 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.100482 Jan 05 18:17:43.560177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 667/1286] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:43 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:44.509428 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:44.510446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:44.516931 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:44.517387 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:44.518183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:44.519262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:44.572086 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:44.573098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:44.579498 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:44.579941 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:44.580701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:44.581324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:44.604599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-22fdff3e-61ec-4e96-9e2b-8615e56bba45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.099060 Jan 05 18:17:44.606354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 620/1287] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:44 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:44.663528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-30c1f1f7-e36c-4a56-adcc-10da07962ef6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095223 Jan 05 18:17:44.664177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 668/1288] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:44 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:45.618393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:45.619393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:45.625855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:45.626331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:45.627096 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:45.627529 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:45.676237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:45.677257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:45.683690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:45.684131 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:45.684908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:45.685343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:45.719185 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8c69c8a3-0c8a-4102-a570-70d7826a5e63 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.104918 Jan 05 18:17:45.720077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 621/1289] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:45 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:45.767481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-90af3e08-589d-4dcd-b19c-e8c10873dd9a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095894 Jan 05 18:17:45.768102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 669/1290] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:45 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:46.732135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:46.733145 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:46.740146 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:46.740591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:46.741354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:46.741784 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:46.778688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:46.779684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:46.786509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:46.786964 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:46.787731 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:46.788168 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:46.829140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-11da222f-d310-48fb-a1d6-fdce8657e855 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.101148 Jan 05 18:17:46.829794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 622/1291] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:46 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:46.882348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8316d4c0-faeb-4e0b-9823-b28c17f30b5c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.107405 Jan 05 18:17:46.882923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 670/1292] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:46 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:47.841381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:47.842409 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:47.849006 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:47.855345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:47.855345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:47.855345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:47.894258 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:47.895189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:47.901593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:47.902068 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:47.902842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:47.903276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:47.931852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4b789b2c-69f0-4ee2-852f-e8b9464a9c89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.094321 Jan 05 18:17:47.932533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 623/1293] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:47 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:47.985355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9fe7d823-4c85-4c1f-92f9-896d24769b21 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095536 Jan 05 18:17:47.986031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 671/1294] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:47 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:48.944266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:48.945263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:48.951653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:48.952101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:48.952863 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:48.953296 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:48.997089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:48.998113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:49.004747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:49.005199 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:49.005976 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:49.006444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:49.057302 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a61d6268-11d3-43ca-874b-82c9c7c2df85 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.117235 Jan 05 18:17:49.057951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 624/1295] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:48 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:17:49.118192 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3d96be0f-7206-49ee-b199-09e0cf740c66 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.124933 Jan 05 18:17:49.118828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 672/1296] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:48 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:50.069507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:50.070522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:50.076888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:50.077327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:50.078180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:50.078613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:50.129826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:50.130877 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:50.137206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:50.137658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:50.138457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:50.138896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:50.166905 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-737daec1-8e5f-4db4-8252-c2d7ad6829ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.101496 Jan 05 18:17:50.167581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 625/1297] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:50 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:50.227083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0f997db8-13e2-4a9d-b5b6-1f135063fe74 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.101233 Jan 05 18:17:50.227720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 673/1298] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:50 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:51.179656 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:51.180717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:51.187042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:51.187483 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:51.188257 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:51.188686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:51.240231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:51.241277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:51.247692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:51.248145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:51.248919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:51.249401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:51.269520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-59f53caf-065f-4872-a7d5-47c5d56700d0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.094253 Jan 05 18:17:51.271126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 626/1299] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:51 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:51.326692 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1e9194c2-0367-4580-ba08-c19ed676055f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.090896 Jan 05 18:17:51.327319 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 674/1300] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:51 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:52.281274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:52.282317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:52.288797 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:52.289250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:52.290037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:52.290487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:52.338603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:52.339592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:52.345920 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:52.346396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:52.347157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:52.347590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:52.376163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1da632c9-bd87-4847-b8fc-6024ee90e400 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 28655 microversion: 2.20 time: 0.098773 Jan 05 18:17:52.376819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 627/1301] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:52 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 28655 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:52.429536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fae3d642-e110-4e73-ab8c-4b75b91a9f48 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.094830 Jan 05 18:17:52.430175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 675/1302] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:52 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:53.388075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:53.389044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:53.396224 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:53.396662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:53.397416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:53.397844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:53.441686 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:53.442702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:53.449018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:53.449470 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:53.450273 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:53.450720 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:53.490565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8f8bb944-a0a4-4bab-a134-d73a8159d02e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 30032 microversion: 2.20 time: 0.106334 Jan 05 18:17:53.491222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 628/1303] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:53 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 30032 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:53.548065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-66c74ee4-a57e-47cf-a05c-c277be080386 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.110847 Jan 05 18:17:53.548695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 676/1304] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:53 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:54.503453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:54.504402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:54.510845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:54.511297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:54.512065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:54.512503 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:54.560632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:54.561626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:54.568764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:54.569211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:54.569985 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:54.570446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:54.610717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e19b6a42-6ff1-4ffb-84c1-0e39a531c6f4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 32002 microversion: 2.20 time: 0.111748 Jan 05 18:17:54.611382 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 629/1305] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:54 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 32002 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:54.664840 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ab560b11-6039-4966-9df1-24b61c99a3a5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.108008 Jan 05 18:17:54.665422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 677/1306] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:54 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:55.623118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:55.624118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:55.631254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:55.633032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:55.633032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:55.633032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:55.676645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:55.677676 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:55.684064 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:55.684497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:55.685265 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:55.685697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:55.719894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-47d0da84-0d4a-4b09-84fe-bdaef0d6190f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 33101 microversion: 2.20 time: 0.100635 Jan 05 18:17:55.720564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 630/1307] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:55 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 33101 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:55.771434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1e32ddc1-5c46-4ee7-b51c-b2abf37007d2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.098668 Jan 05 18:17:55.772072 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 678/1308] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:55 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:56.731907 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:56.732923 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:56.740026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:56.740456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:56.741250 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:56.741685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:56.783211 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:56.785352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:56.791632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:56.792080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:56.792843 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:56.793278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:56.829767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-85d7461a-6226-4394-aeac-8efbbdbf6c99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 34436 microversion: 2.20 time: 0.102123 Jan 05 18:17:56.831687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 631/1309] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:56 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 34436 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:56.880373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ab725cbe-01cd-48cb-a11f-11f52d9feb85 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.100900 Jan 05 18:17:56.881014 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 679/1310] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:56 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:57.842884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:57.843881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:57.851097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:57.854294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:57.854294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:57.854294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:57.893189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:57.893189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:57.899389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:57.899837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:57.900648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:57.901081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:57.948768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-364d7123-570c-4c35-ab05-a0ba69b8d80d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 35808 microversion: 2.20 time: 0.109839 Jan 05 18:17:57.949423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 632/1311] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:57 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 35808 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:58.000342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4ad45e57-5da1-44b9-acc1-ef9db2ff1397 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.111987 Jan 05 18:17:58.000971 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 680/1312] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:57 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:17:58.960398 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:58.961408 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:58.967829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:58.968274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:58.969036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:58.969462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:59.012286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:17:59.013315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:17:59.019706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:59.020156 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:59.020932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:17:59.021375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:17:59.064285 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a20a8674-bd92-4edf-a4b2-320ca2eb7a4a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 37611 microversion: 2.20 time: 0.107876 Jan 05 18:17:59.065868 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 633/1313] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:17:58 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 37611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:17:59.121133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ca59aed8-83e8-4c99-8977-d3c2429ff815 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.112710 Jan 05 18:17:59.121771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 681/1314] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:17:59 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:00.077556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:00.078576 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:00.086046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:00.086515 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:00.087288 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:00.087723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:00.133618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:00.134652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:00.141133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:00.141582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:00.142377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:00.143444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:00.175532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-14b6df13-6d32-4307-82e7-d94809ef869f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 38196 microversion: 2.20 time: 0.101903 Jan 05 18:18:00.176187 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 634/1315] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:00 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 38196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 05 18:18:00.223041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-217cf2e6-8a9b-42d2-8856-e5ac07a08d8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.093230 Jan 05 18:18:00.223701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 682/1316] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:00 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:01.188109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:01.189102 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:01.196407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:01.196844 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:01.197696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:01.198142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:01.234967 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:01.235948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:01.243159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:01.243605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:01.244374 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:01.244806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:01.279915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c608df69-622f-48df-ba91-8c07c06d4eb0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 38196 microversion: 2.20 time: 0.095783 Jan 05 18:18:01.280558 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 635/1317] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:01 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 38196 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:01.328455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8d1b2504-eaf2-4373-b480-2b6f5c81f4ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.097201 Jan 05 18:18:01.329100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 683/1318] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:01 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:02.291962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:02.292958 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:02.299497 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:02.299882 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:02.300672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:02.301108 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:02.339757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:02.340754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:02.347161 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:02.347606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:02.348364 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:02.348793 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:02.391952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2ddebe88-5561-44fd-a5e5-303d6f1896a2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 38196 microversion: 2.20 time: 0.103861 Jan 05 18:18:02.392612 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 636/1319] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:02 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 38196 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:02.442476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c4f5f44f-fb0a-436f-bfbc-5a0c485780e4 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.106440 Jan 05 18:18:02.443106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 684/1320] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:02 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:03.405248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:03.454789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:03.454789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:03.454789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:03.454789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:03.455247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:03.455342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:03.455794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:03.461696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:03.462191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:03.462962 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:03.463400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:03.499590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-06bf4997-4dbc-4bf7-9054-30dc0686ce23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 38196 microversion: 2.20 time: 0.098323 Jan 05 18:18:03.500246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 637/1321] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:03 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 38196 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:03.558817 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a84a3096-4006-4ed1-b059-8be4b776ce93 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.108353 Jan 05 18:18:03.559457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 685/1322] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:03 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:04.512371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:04.513369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:04.520563 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.521011 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.521782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.522259 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.571225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:04.572248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:04.578696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.579145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.579908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.581376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.608312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d2682aae-cccf-4b0b-a905-3e11db03fc45 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 200 len: 38337 microversion: 2.20 time: 0.099811 Jan 05 18:18:04.609017 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 638/1323] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:04 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 38337 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:04.621459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:04.621459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:04.626281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.626678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.628012 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:04.628447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:04.652033 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-8bc4ba9d-e865-4142-8d1e-ed5888c6922d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/ips" status: 200 len: 152 microversion: 2.20 time: 0.036455 Jan 05 18:18:04.652605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 639/1324] 10.222.0.26 () {60 vars in 1288 bytes} [Wed Jan 5 18:18:04 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:04.659324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-fc453179-cc34-4f57-803e-5f306afeafa3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.091882 Jan 05 18:18:04.663083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 686/1325] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:04 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:05.670831 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:05.671768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:05.678731 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:05.679175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:05.679934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:05.680367 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:05.762374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5568360d-f9c1-4187-b429-b82a07674017 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095108 Jan 05 18:18:05.763042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 640/1326] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:05 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:06.774889 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:06.775928 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:06.782262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:06.782711 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:06.783509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:06.783950 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:06.869117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2f103c80-ed07-43f3-87f8-2f3e1ffa6200 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.098027 Jan 05 18:18:06.869690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 687/1327] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:06 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:07.881448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:07.882407 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:07.888837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:07.891773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:07.891773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:07.891773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:07.972833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-47ee5e14-78ac-430e-bc31-df9c23c22e8c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 28639 microversion: 2.1 time: 0.095455 Jan 05 18:18:07.973707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 641/1328] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:07 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 28639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:08.291115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:08.291776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:08.298152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.298600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:08.299642 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.300080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:08.322261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lazy-loading 'flavor' on Instance uuid 0237b7dd-8018-4706-b3fa-4156d3629d88 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:08.816259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df95ec95-1bc3-4868-86e9-c43d389c70a9 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 202 len: 0 microversion: 2.20 time: 0.528825 Jan 05 18:18:08.816818 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 688/1329] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:08 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:18:08.825488 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:08.826248 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:08.833016 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.833505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:08.834326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.834765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:08.956921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:08.964578 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:08.966101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:08.967256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d5526e4-c69c-4dfa-af93-4ba7d91d02e0 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.146067 Jan 05 18:18:08.967820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 642/1330] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:08 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:08.984188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:08.985172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:08.992045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.992491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:08.993244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:08.993670 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:09.102377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-339ff0d5-98f5-4a02-8bd1-85a7dbe241ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 29558 microversion: 2.1 time: 0.121948 Jan 05 18:18:09.102943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 689/1331] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:08 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 29558 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:09.985663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:09.987561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:09.993753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:09.994239 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:09.995014 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:09.995445 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:10.115018 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:10.116008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:10.122740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:10.123294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:10.123756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:10.124543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:10.124980 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:10.130750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:10.132756 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:10.133385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-aac0c2ce-e0d9-4378-872b-11eb2321da46 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.151358 Jan 05 18:18:10.133942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 643/1332] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:09 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:10.226174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-495179fe-610b-4794-bf9a-985fe345e3e6 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 31662 microversion: 2.1 time: 0.115138 Jan 05 18:18:10.226977 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 690/1333] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:10 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 31662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:11.153599 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:11.154222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:11.160396 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:11.160846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:11.161615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:11.162074 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:11.239242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:11.240249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:11.246647 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:11.247100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:11.247881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:11.248328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:11.286155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:11.293766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:11.295311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:11.296462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-194f153d-d2ee-4604-9187-21399316bfbe tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.146659 Jan 05 18:18:11.297018 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 644/1334] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:11 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:12.316505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:12.317126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:12.323171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:12.323617 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:12.324374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:12.324806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:12.443585 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:12.451157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:12.452642 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:12.453790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f3ae6005-e3ca-48ef-ba34-736f5c149412 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.141712 Jan 05 18:18:12.454384 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 645/1335] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:12 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:13.471687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:13.472321 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:13.478060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:13.478508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:13.479523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:13.479947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:13.601216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:13.609206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:13.615043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:13.615043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-97c944ec-18d7-49d4-b3c7-31d3cd4dbc1c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.144689 Jan 05 18:18:13.615043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 646/1336] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:13 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:14.631229 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:14.631827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:14.637681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:14.638111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:14.638880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:14.639318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:14.696239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-eff31128-90ad-420c-b579-6f487af76bf9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 37467 microversion: 2.1 time: 3.461518 Jan 05 18:18:14.697234 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 691/1337] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:11 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 37467 bytes in 3463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:14.761304 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:14.768879 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:14.770383 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:14.771516 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-52d1b817-8c32-4b65-bcea-0e5c2f491806 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.144807 Jan 05 18:18:14.772068 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 647/1338] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:14 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:15.709244 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:15.710263 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:15.716593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:15.717035 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:15.717802 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:15.718259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:15.788634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:15.789348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:15.795221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:15.795644 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:15.796422 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:15.796891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:15.832896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6b6a3915-3d0c-465c-b220-d92ca8d28eda tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 38173 microversion: 2.1 time: 0.128202 Jan 05 18:18:15.833677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 692/1339] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:15 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 38173 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:15.917174 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:15.924940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:15.926469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:15.927621 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9431ebfb-93f2-43ee-8170-f261d44ff731 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.142648 Jan 05 18:18:15.928180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 648/1340] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:15 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:16.844408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:16.845407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:16.851936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:16.852381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:16.853147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:16.853581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:16.937493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5aea4de9-ead8-41bf-9042-132c57818690 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 38173 microversion: 2.1 time: 0.096936 Jan 05 18:18:16.938195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 693/1341] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:16 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 38173 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:16.945871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:16.946527 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:16.952770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:16.953220 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:16.953989 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:16.954451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:17.082229 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:17.089766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:17.091303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:17.092452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-63c20bd0-c8d3-4b39-a53f-576bb71e0c23 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.150304 Jan 05 18:18:17.093008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 649/1342] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:16 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:17.950214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:17.951196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:17.957537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:17.957981 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:17.958774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:17.959201 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:18.049500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-081f7891-5c30-4681-a570-2c9d4e94e1e2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 38173 microversion: 2.1 time: 0.102711 Jan 05 18:18:18.050157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 694/1343] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:17 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 38173 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:18.110317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:18.111629 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:18.117485 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:18.117924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:18.118719 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:18.119151 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:18.239341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:18.246885 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:18.248357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:18.249493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7b70b56a-ec65-4137-bb89-18fc70eec57c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.142921 Jan 05 18:18:18.250064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 650/1344] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:18 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:19.062384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:19.063379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:19.070477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:19.070925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:19.071684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:19.072115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:19.175185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8ccdffa4-c81a-4602-9a84-4afecd52ed2f tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 38173 microversion: 2.1 time: 0.116707 Jan 05 18:18:19.176093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 695/1345] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:19 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 38173 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:19.267195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:19.268123 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:19.273883 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:19.274368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:19.275132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:19.275567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:19.393793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:19.401453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:19.402979 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:19.404132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e3bbd220-516b-4b42-8df2-f6ffc9649508 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.140808 Jan 05 18:18:19.404687 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 651/1346] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:19 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:20.187597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:20.188587 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:20.195433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.195890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.196646 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.197076 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.332149 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-59f733b5-ab67-4e00-b87e-57b6755d0233 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action" status: 200 len: 38304 microversion: 2.1 time: 0.148531 Jan 05 18:18:20.332801 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 696/1347] 10.222.0.26 () {60 vars in 1277 bytes} [Wed Jan 5 18:18:20 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/action => generated 38304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 05 18:18:20.342510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:20.342982 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:20.348867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.349317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.350116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.350555 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.372846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-efd5bc62-ba8a-4c0f-be5e-c028a01fd93a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/ips" status: 200 len: 146 microversion: 2.1 time: 0.033941 Jan 05 18:18:20.373391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 652/1348] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:18:20 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/ips => generated 146 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:20.422461 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:20.423181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:20.429460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.429913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.430714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:20.431148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:20.784193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:20.791721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:20.793213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:20.794387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b2fff1c2-ae3a-4d14-b54d-30e2c744b851 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.375881 Jan 05 18:18:20.794938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 697/1349] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:20 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:21.812523 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:21.813112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:21.819320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:21.819767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:21.820530 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:21.820966 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:21.940911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:21.948653 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:21.950216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:21.951376 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0ea5aafb-b0b4-4d59-a3ea-fe6e5bee4c08 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.142619 Jan 05 18:18:21.951935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 653/1350] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:21 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:22.779844 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-996021698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-84115276", "security_groups": [{"name": "tempest-secgroup-smoke-143875598"}], "block_device_mapping_v2": [{"uuid": "d891347f-7dd5-4d2e-99f8-fda2275c5812", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f66398-92a1-4614-82f3-d4ba84635ba6"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:22.881173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] validate_networks() for [('f6f66398-92a1-4614-82f3-d4ba84635ba6', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:18:22.968964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:22.969602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:22.975245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:22.975689 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:22.976447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:22.976876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:23.106448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:23.114633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:23.116175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:23.117317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-43226a15-636c-49d7-9c97-a2730df5a080 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.152076 Jan 05 18:18:23.117885 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 654/1351] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:22 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:23.122292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc17777b-1732-4225-9b0e-50f83464d657"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:23.123331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:23.129431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:23.132695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:23.132695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:23.132695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:23.370100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:18:23.370517 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:18:23.370984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:18:23.371382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:18:23.371782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:18:23.380718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:23.381160 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:23.381947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:23.382403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:23.398940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:18:23.403444 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Getting quotas for user 15c202797c1440e1beb37e997904ac04 and project 08e68392448c4624aa2ae32698c65e8d. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:18:23.462785 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:18:23.464906 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d891347f-7dd5-4d2e-99f8-fda2275c5812',volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:18:23.828349 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [1ea580eb-9457-4ab5-afe4-948e62f90ab8] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 05 18:18:23.832290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-55d5ba6c-55a5-4e5c-ba7b-999db2a7d4ab tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712661 Jan 05 18:18:23.832901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 655/1352] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:18:23 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:24.136419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:24.137044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:24.142970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:24.143417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:24.144865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:24.145307 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:24.265118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:24.273571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:24.275088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:24.276227 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cc22a2dd-3a40-4db9-8171-ea74bcf7158a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.143976 Jan 05 18:18:24.276783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 656/1353] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:24 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:24.835685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [1ea580eb-9457-4ab5-afe4-948e62f90ab8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37756. Jan 05 18:18:24.839834 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f9a7a213-3600-4fb4-bf97-d56a60a816bc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.063709 Jan 05 18:18:24.840487 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 698/1354] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:18:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:18:24.850859 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f44698a9-8911-4231-ac71-497c9b3b4d2f tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:24.851462 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f44698a9-8911-4231-ac71-497c9b3b4d2f tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:24.907981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f44698a9-8911-4231-ac71-497c9b3b4d2f tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:24.915425 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f44698a9-8911-4231-ac71-497c9b3b4d2f tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1092 microversion: 2.1 time: 0.068770 Jan 05 18:18:24.916193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 657/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:24 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1092 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:25.294235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:25.294851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:25.301510 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:25.301961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:25.302757 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:25.303193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:25.424408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:25.432291 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:25.433773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:25.434963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b5ac58da-e549-4984-b6a3-97de65340a8e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.144612 Jan 05 18:18:25.435552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 699/1356] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:25 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:25.932364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:25.932978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:25.939200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:25.939648 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:25.940412 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:25.940846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:25.999829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:26.014615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9d091066-d061-4095-98d5-9c325ff651b2 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1142 microversion: 2.1 time: 0.079511 Jan 05 18:18:26.014615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 658/1357] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:25 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1142 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:26.452491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:26.453083 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:26.458859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:26.459302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:26.460061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:26.460497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:26.575948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:26.584546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:26.586042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:26.587218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f7a935b2-57e7-425f-a84d-7b91b49a2aab tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.138505 Jan 05 18:18:26.587774 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 700/1358] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:26 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:27.024701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:27.025323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:27.031632 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:27.032081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:27.032887 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:27.033319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:27.105311 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:27.113509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-990141ed-9b77-4e5f-b6ce-bb95bf55da91 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1198 microversion: 2.1 time: 0.092068 Jan 05 18:18:27.121077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 659/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:27 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:27.606830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:27.607448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:27.613953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:27.618126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:27.619150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:27.619618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:27.758930 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:27.766179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:27.768025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:27.769555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b7081ee8-8365-4b0a-badb-c10773ed76fa tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.166798 Jan 05 18:18:27.770333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 701/1360] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:27 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:28.130193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:28.130872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:28.136351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:28.136803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:28.137568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:28.138100 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:28.353378 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:28.361413 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1493cc29-5785-4508-a235-ca20feda056d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1275 microversion: 2.1 time: 0.235444 Jan 05 18:18:28.372374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 660/1361] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:28 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:28.729794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-909a7cd1-6c0b-4758-ae06-817b4e11ded3 req-dc73cd28-1c9e-4a34-bdbb-2b01faa1c13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b67721d-e2c6-4b8a-a742-ec6d95782f6e", "tag": "3d2f98d0-8524-434e-9104-c73e7263cf78"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:28.733005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:28.733005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:18:28.739331 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-909a7cd1-6c0b-4758-ae06-817b4e11ded3 req-dc73cd28-1c9e-4a34-bdbb-2b01faa1c13c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:28.739984 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-909a7cd1-6c0b-4758-ae06-817b4e11ded3 req-dc73cd28-1c9e-4a34-bdbb-2b01faa1c13c service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:28.753507 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-909a7cd1-6c0b-4758-ae06-817b4e11ded3 req-dc73cd28-1c9e-4a34-bdbb-2b01faa1c13c service nova] Creating event network-changed:3d2f98d0-8524-434e-9104-c73e7263cf78 for instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e on hv-cinder-xena0 Jan 05 18:18:28.756581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-909a7cd1-6c0b-4758-ae06-817b4e11ded3 req-dc73cd28-1c9e-4a34-bdbb-2b01faa1c13c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165713 Jan 05 18:18:28.757184 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 702/1362] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:28.789075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:28.789693 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:28.795399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:28.795786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:28.796540 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:28.796970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:28.998886 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:29.007341 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:29.008822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:29.009964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ba2c976f-93c4-4be5-a18b-3be90b3fd472 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.225175 Jan 05 18:18:29.010547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 661/1363] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:28 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:29.380246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:29.383648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:29.392491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:29.392936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:29.393705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:29.394218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:29.515957 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:29.523816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-194d8156-1b69-4bb9-8ebc-f47bcf8060cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1275 microversion: 2.1 time: 0.148208 Jan 05 18:18:29.524580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 703/1364] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:29 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:29.889894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-f150cedf-733b-42b0-b941-d5973b2898c8 req-39dc53e3-65d9-4458-9a25-f11aa7fd786a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "name": "network-vif-plugged", "status": "completed", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:29.891470 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:29.891470 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:18:29.898596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f150cedf-733b-42b0-b941-d5973b2898c8 req-39dc53e3-65d9-4458-9a25-f11aa7fd786a service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:29.899033 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f150cedf-733b-42b0-b941-d5973b2898c8 req-39dc53e3-65d9-4458-9a25-f11aa7fd786a service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:29.910113 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-f150cedf-733b-42b0-b941-d5973b2898c8 req-39dc53e3-65d9-4458-9a25-f11aa7fd786a service nova] Creating event network-vif-plugged:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:18:29.915254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-f150cedf-733b-42b0-b941-d5973b2898c8 req-39dc53e3-65d9-4458-9a25-f11aa7fd786a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088014 Jan 05 18:18:29.915837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 662/1365] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:30.027816 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:30.028574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:30.034419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:30.035405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:30.036281 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:30.036890 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:30.158323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:30.165863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:30.167426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:30.168572 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b0dad797-1af4-4d0a-8df2-86ebbabde243 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.144535 Jan 05 18:18:30.169129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 704/1366] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:30 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:30.540638 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:30.541335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:30.547281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:30.547729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:30.548493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:30.548925 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:30.668491 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:30.675738 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-794913d4-13d6-44d9-bafa-9830f9da47a1 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1275 microversion: 2.1 time: 0.138951 Jan 05 18:18:30.676319 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 663/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:30 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:31.185841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:31.186618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:31.193194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:31.193645 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:31.194458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:31.194895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:31.320491 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:31.328000 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:31.329494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:31.330658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3fc87f92-0025-44e2-9474-3b0e720211c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.148604 Jan 05 18:18:31.331214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 705/1368] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:31 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:31.693020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:31.693561 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:31.700091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:31.700543 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:31.701353 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:31.701791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:31.824852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:31.832833 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-27b84f5b-ad44-4d61-ac3f-1e1ba22fed6b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1275 microversion: 2.1 time: 0.144364 Jan 05 18:18:31.833380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 664/1369] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:31 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:32.348005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:32.348600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:32.354555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.354999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.355856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.356290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.425866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:32.426823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:32.432544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.432981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.433761 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.435038 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.465327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-33233de4-f65b-42ca-ba68-2d2f20291e13 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Jan 05 18:18:32.466131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 665/1370] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:18:32 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:18:32.475603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:32.476101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:32.478637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:32.482008 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.482492 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.483266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.483706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.486426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:32.487902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:32.490207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c506f689-a32d-4071-89d1-c64fe377f22e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1744 microversion: 2.20 time: 0.145941 Jan 05 18:18:32.493320 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 706/1371] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:32 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1744 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:32.513140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e668e8d0-ee02-4b89-b5a1-29d2b77fd16d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657" status: 200 len: 194 microversion: 2.1 time: 0.041386 Jan 05 18:18:32.513709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 666/1372] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jan 5 18:18:32 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:18:32.848675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:32.849317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:32.855663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.856105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.856865 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:32.857294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:32.979865 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:32.987613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-32672560-1141-4a9f-998f-1ef97b747e68 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1275 microversion: 2.1 time: 0.142815 Jan 05 18:18:32.988873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 707/1373] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:32 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:33.509256 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:33.510218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:33.516109 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:33.516556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:33.517322 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:33.517757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:33.643664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:33.652985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:33.654520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:33.655665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2d7f4a28-d533-4d0d-ad11-192aec8761ca tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.150124 Jan 05 18:18:33.656213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 667/1374] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:33 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:34.005638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:34.006489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:34.012611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:34.013062 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:34.013829 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:34.014294 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:34.164257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:34.172563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9e2ae17e-0a39-495a-9fc3-f6bec7a91e66 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.171774 Jan 05 18:18:34.179302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 708/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:33 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:34.673812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:34.674602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:34.680654 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:34.681101 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:34.681877 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:34.686696 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:34.823399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:34.831519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:34.833278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:34.834570 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-272d5f04-b7ff-412b-8777-67e9c16b302d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.164655 Jan 05 18:18:34.835126 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 668/1376] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:34 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:35.190937 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:35.191764 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:35.197991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.198474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.198636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f48eb3d9-29c8-4b22-b731-4c63bf0b03c1"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:35.199589 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.199867 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:35.200023 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.206047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.206607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.207568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.208066 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.343005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:35.351628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-eb6b0bc1-3aba-429c-8dd7-c6bfd280634c tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.164276 Jan 05 18:18:35.352194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 709/1377] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:35 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:35.853389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:35.854464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:35.860913 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.861567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.862545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:35.863671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:35.956159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1b71dfd7-c8da-4c9d-9a2f-54b078b02129 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761328 Jan 05 18:18:35.963349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 669/1378] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:18:35 2022] POST /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:36.001133 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:36.010778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:36.013336 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:36.014932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9e4a99c8-7ad8-41fd-b89e-689cce2aae9d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.165941 Jan 05 18:18:36.016455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 710/1379] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:35 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:36.369582 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:36.370236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:36.377193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:36.377610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:36.378443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:36.379094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:36.520196 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:36.527785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-33b29caf-c656-48f8-828b-620bc913d9ee tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.162498 Jan 05 18:18:36.528345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 670/1380] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:36 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:37.042771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:37.043782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:37.049520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:37.053022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:37.053022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:37.053022 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:37.186867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:37.195696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:37.197214 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:37.199559 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3e3bc818-4d14-4708-bff6-a26ddce5adac tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.160741 Jan 05 18:18:37.200544 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 711/1381] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:37 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:37.545067 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:37.546297 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:37.554095 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:37.554537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:37.555301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:37.555732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:37.864841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:37.872279 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b6d7e11e-41be-4d4e-994f-3cbb857daa64 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.331383 Jan 05 18:18:37.872855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 671/1382] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:37 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:38.217708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:38.218515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:38.225827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:38.226423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:38.227449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:38.228030 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:38.368377 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:38.376396 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:38.378221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:38.380085 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-50c09872-98af-46d0-a39c-f9ad4a8a6ab7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.166109 Jan 05 18:18:38.380637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 712/1383] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:38 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:38.890868 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:38.891894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:38.902758 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:38.903308 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:38.904161 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:38.904667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:39.037497 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:39.046967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-807f0a05-0549-4944-bc5f-b4971f2fd9d4 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.160142 Jan 05 18:18:39.055006 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 672/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:38 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:39.407516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:39.408482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:39.415363 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:39.415842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:39.416669 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:39.417125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:39.547849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:39.557114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:39.558640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:39.559802 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ee5b80ab-f6ce-4f03-ac48-336b51df8e71 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.163772 Jan 05 18:18:39.560362 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 713/1385] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:39 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:40.064636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:40.065251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:40.076859 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:40.077457 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:40.078373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:40.078895 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:40.204978 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:40.212920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-efa3b5e0-b3f0-44d3-8022-11d5fb33df53 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.152018 Jan 05 18:18:40.213506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 673/1386] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:40 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:40.578307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:40.579693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:40.586752 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:40.587206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:40.588015 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:40.588455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:40.739224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:40.748959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:40.750504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:40.751726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7c0599a7-4bb2-417b-af1c-32e55d4ab5d4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.177068 Jan 05 18:18:40.762618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 714/1387] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:40 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:41.230508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:41.231894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:41.238320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:41.238836 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:41.239679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:41.240336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:41.395795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:41.403662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6adfd84c-b51a-4533-bf68-336d665f6bf0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.176901 Jan 05 18:18:41.404559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 674/1388] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:41 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:41.771422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:41.772117 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:41.777797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:41.778285 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:41.779077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:41.779518 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:41.918261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:41.927202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:41.930600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:41.932690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-958a8cca-1a1e-44c2-803f-0beaa10a2c0a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.165984 Jan 05 18:18:41.933809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 715/1389] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:41 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:42.421808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:42.423218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:42.429648 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:42.430122 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:42.430911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:42.431402 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:42.555537 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:42.564738 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-19fea160-d872-4464-b058-90b84ba14fb0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.146724 Jan 05 18:18:42.565399 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 675/1390] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:42 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:42.952424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:42.953333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:42.959446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:42.959891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:42.960870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:42.961302 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:43.100110 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:43.108111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:43.109593 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:43.110770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8fb82109-0e1f-490d-82e9-3b97091f97f2 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.162388 Jan 05 18:18:43.111329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 716/1391] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:42 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:43.583232 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:43.584021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:43.593591 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:43.594208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:43.595060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:43.595556 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:43.737566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:43.746131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-efac79ff-10b0-4eaf-8779-e3162eb197a6 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.167549 Jan 05 18:18:43.755247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 676/1392] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:43 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:44.129524 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:44.130105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:44.136038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:44.137652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:44.137652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:44.137874 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:44.265555 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:44.273210 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:44.274722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:44.275917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-667235a1-11a6-4182-aab9-a48acf34d510 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.151077 Jan 05 18:18:44.276478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 717/1393] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:44 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:44.762597 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:44.763223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:44.768991 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:44.769431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:44.770230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:44.770677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:44.889296 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:44.896673 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c648bf86-a1cc-4c48-b1ff-ade9a88cd97e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.137655 Jan 05 18:18:44.897263 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 677/1394] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:44 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:45.294455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:45.295089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:45.301262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.301715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.302522 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.302959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.418441 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:45.426225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:45.427736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:45.428891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9d1a2f67-bb57-4009-873e-ac4d3a255575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1739 microversion: 2.20 time: 0.138089 Jan 05 18:18:45.429450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 718/1395] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:45 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1739 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:45.668669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:45.669730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:45.676071 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.676552 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.677330 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.677770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.709603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9ef40d90-c8a4-4988-a9d7-70145cc60abd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044768 Jan 05 18:18:45.710195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 678/1396] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:18:45 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:18:45.913185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:45.913798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:45.919847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.920295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.921277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.921713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.976786 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:45.978208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:45.985534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.986271 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:45.987339 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:45.988815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.032299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a44e746a-f919-48d4-95ae-bb7c607ada2c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657" status: 200 len: 194 microversion: 2.1 time: 0.059853 Jan 05 18:18:46.038658 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 679/1397] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jan 5 18:18:45 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:18:46.043710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:46.044813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:46.051683 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:46.052714 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.053721 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:46.054342 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.068671 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:46.076279 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-28420d89-b6d1-45be-ac95-69d8f622b232 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.167297 Jan 05 18:18:46.086690 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 719/1398] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:45 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:18:46.105145 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-372b8245-00e6-4254-bbfb-ae632e174559 req-fec4708f-61d0-4c8b-ba1d-1238baa06cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b67721d-e2c6-4b8a-a742-ec6d95782f6e", "name": "network-vif-plugged", "status": "completed", "tag": "3d2f98d0-8524-434e-9104-c73e7263cf78"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:46.118644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:46.118644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:18:46.132735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-372b8245-00e6-4254-bbfb-ae632e174559 req-fec4708f-61d0-4c8b-ba1d-1238baa06cd5 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:46.133399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-372b8245-00e6-4254-bbfb-ae632e174559 req-fec4708f-61d0-4c8b-ba1d-1238baa06cd5 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.148114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-372b8245-00e6-4254-bbfb-ae632e174559 req-fec4708f-61d0-4c8b-ba1d-1238baa06cd5 service nova] Creating event network-vif-plugged:3d2f98d0-8524-434e-9104-c73e7263cf78 for instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e on hv-cinder-xena0 Jan 05 18:18:46.153888 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-372b8245-00e6-4254-bbfb-ae632e174559 req-fec4708f-61d0-4c8b-ba1d-1238baa06cd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052361 Jan 05 18:18:46.155208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 720/1399] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:46.169913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'services' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:46.447371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a1236677-cead-4ca8-9e83-2978a9ecd0ce tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657" status: 202 len: 0 microversion: 2.1 time: 0.402338 Jan 05 18:18:46.448200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:46.448899 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:46.453852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 680/1400] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:18:46 2022] DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/cc17777b-1732-4225-9b0e-50f83464d657 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:46.457724 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:46.458208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.459002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:46.459440 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:46.626150 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:46.635089 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:46.636825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:46.638125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-badba48c-dd70-4b4b-a1d1-216565e0b641 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1721 microversion: 2.20 time: 0.193887 Jan 05 18:18:46.638770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 721/1401] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:46 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:47.094240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:47.094937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:47.101520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:47.101967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:47.102762 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:47.103200 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:47.226465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:47.233856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-830b2761-e08d-4f54-bc9c-eaa09caa2f86 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.143721 Jan 05 18:18:47.234443 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 681/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:47 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:47.838407 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:47.839046 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:47.844730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:47.845178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:47.845947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:47.846405 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:47.963995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:47.971535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:47.973515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:47.974701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-132c7aa3-4aed-4500-9040-a88302cfb03e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1721 microversion: 2.20 time: 0.321128 Jan 05 18:18:47.975261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 722/1403] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:47 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:48.169466 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-540fa21c-0356-4a7f-8e0e-1e788641cc6e req-6d1a0ef9-9032-402e-9f0e-ee9b1144be65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "name": "network-vif-unplugged", "status": "completed", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:48.170988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:48.170988 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:18:48.178328 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-540fa21c-0356-4a7f-8e0e-1e788641cc6e req-6d1a0ef9-9032-402e-9f0e-ee9b1144be65 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.178849 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-540fa21c-0356-4a7f-8e0e-1e788641cc6e req-6d1a0ef9-9032-402e-9f0e-ee9b1144be65 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.189446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-540fa21c-0356-4a7f-8e0e-1e788641cc6e req-6d1a0ef9-9032-402e-9f0e-ee9b1144be65 service nova] Creating event network-vif-unplugged:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:18:48.194204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-540fa21c-0356-4a7f-8e0e-1e788641cc6e req-6d1a0ef9-9032-402e-9f0e-ee9b1144be65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028438 Jan 05 18:18:48.194791 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 682/1404] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:48.250791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:48.251427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:48.257590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.258065 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.258835 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.259267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.376496 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:48.383848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-da4c7feb-faf3-4406-ab74-dd803cffc058 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1263 microversion: 2.1 time: 0.136708 Jan 05 18:18:48.384414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 723/1405] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:48 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1263 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:48.653097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:48.660871 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:48.661812 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.662294 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.664646 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.665093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.694631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7dcd8d37-c53b-423c-b45f-6f7f89b3a5d9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/f48eb3d9-29c8-4b22-b731-4c63bf0b03c1" status: 200 len: 194 microversion: 2.1 time: 0.048427 Jan 05 18:18:48.695210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 683/1406] 10.222.0.26 () {58 vars in 1412 bytes} [Wed Jan 5 18:18:48 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/f48eb3d9-29c8-4b22-b731-4c63bf0b03c1 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:48.704626 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:48.710479 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:48.711598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.712048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.712819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.713254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:48.798678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'services' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:48.993153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:48.993783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:48.999452 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:48.999889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.000640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:49.001067 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.019634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bf8efee7-aff9-4e5b-aea5-86e60d7b860a tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/f48eb3d9-29c8-4b22-b731-4c63bf0b03c1" status: 202 len: 0 microversion: 2.1 time: 0.318474 Jan 05 18:18:49.020376 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 724/1407] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:18:48 2022] DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments/f48eb3d9-29c8-4b22-b731-4c63bf0b03c1 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:18:49.124716 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:49.133368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:49.134903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:49.136086 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c790bb79-9884-48ab-9da2-17b6b48afea3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1721 microversion: 2.20 time: 0.146647 Jan 05 18:18:49.136630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 684/1408] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:48 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:49.401144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:49.401832 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:49.408200 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:49.408643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.409403 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:49.410562 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.531385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:49.539166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6a93ae55-a7b9-4b42-9718-6cc208fededa tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1450 microversion: 2.1 time: 0.142020 Jan 05 18:18:49.539727 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 725/1409] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:49 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:49.558575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:49.559189 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:49.564935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:49.565385 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.566241 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:49.566679 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:49.695959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:49.705813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3b87b55f-b422-4059-9bb8-9a9ebb020d39 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1450 microversion: 2.1 time: 0.150640 Jan 05 18:18:49.706366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 685/1410] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:49 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:50.154217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:50.154909 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:50.160867 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:50.161311 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:50.162105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:50.162744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:50.355851 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:50.364547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:50.366171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:50.367378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4d44ecb2-b33d-48d9-b34d-d38acb10560e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1724 microversion: 2.20 time: 0.217128 Jan 05 18:18:50.367937 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 726/1411] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:50 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:50.385230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c77b278d-1f07-43b1-b304-2dcdbeb7e006"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:50.386380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:50.392050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:50.395105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:50.395105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:50.395105 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.267881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:51.269004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:51.275506 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.276181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.276970 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.277408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.309482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1dffb896-5ea3-4215-a5db-47ebf20bf2a7 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045405 Jan 05 18:18:51.310419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 727/1412] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:18:51 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 05 18:18:51.441359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:51.442338 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:51.451458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.452232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.453238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.453963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.479285 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-48cf1f4e-4386-4d53-bd5c-01bf78b22e89 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.097509 Jan 05 18:18:51.486177 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6da7364b-fc62-4252-8ffa-fa34ba0022ac tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048848 Jan 05 18:18:51.490504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 728/1413] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:18:51 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:18:51.490890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 686/1414] 10.222.0.26 () {62 vars in 1363 bytes} [Wed Jan 5 18:18:50 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments => generated 188 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 05 18:18:51.558114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:51.558754 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:51.565159 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.565839 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.567203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.567907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.600581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:18:51.624202 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:51.624977 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:51.635415 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.636186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.637192 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.637698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.908042 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-815450bc-8d9c-415c-9207-d6f55f251545 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 204 len: 0 microversion: 2.1 time: 0.356152 Jan 05 18:18:51.908640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 729/1415] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:18:51 2022] DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:18:51.917180 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:51.917876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:51.923591 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.924041 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:51.924812 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:51.925245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.079019 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:52.086979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9fa7c341-0b87-436e-98f1-1bfa6f618589 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1673 microversion: 2.1 time: 0.173628 Jan 05 18:18:52.087548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 730/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:51 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:18:52.147239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-abae2087-ace6-48aa-97d1-65bc473a9dd0 req-397b33bd-a714-4a38-84d5-4521afd7fac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b67721d-e2c6-4b8a-a742-ec6d95782f6e", "tag": "3d2f98d0-8524-434e-9104-c73e7263cf78"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:52.148717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:52.148717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:18:52.155283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-abae2087-ace6-48aa-97d1-65bc473a9dd0 req-397b33bd-a714-4a38-84d5-4521afd7fac4 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:52.155733 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-abae2087-ace6-48aa-97d1-65bc473a9dd0 req-397b33bd-a714-4a38-84d5-4521afd7fac4 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.167181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-abae2087-ace6-48aa-97d1-65bc473a9dd0 req-397b33bd-a714-4a38-84d5-4521afd7fac4 service nova] Creating event network-changed:3d2f98d0-8524-434e-9104-c73e7263cf78 for instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e on hv-cinder-xena0 Jan 05 18:18:52.171894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-abae2087-ace6-48aa-97d1-65bc473a9dd0 req-397b33bd-a714-4a38-84d5-4521afd7fac4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083256 Jan 05 18:18:52.172873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 731/1417] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:52.279140 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ff8c5865-48b6-46e9-8a43-d3177bc972cd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments/c77b278d-1f07-43b1-b304-2dcdbeb7e006" status: 202 len: 0 microversion: 2.20 time: 0.659380 Jan 05 18:18:52.280179 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 687/1418] 10.222.0.26 () {60 vars in 1456 bytes} [Wed Jan 5 18:18:51 2022] DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments/c77b278d-1f07-43b1-b304-2dcdbeb7e006 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:18:52.341017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:52.341675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:52.348399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:52.348999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.349881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:52.350430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.561483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1557e7f1-9e07-4642-a2cc-ca4227229772 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action" status: 202 len: 0 microversion: 2.20 time: 0.224478 Jan 05 18:18:52.565568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 732/1419] 10.222.0.26 () {62 vars in 1318 bytes} [Wed Jan 5 18:18:52 2022] POST /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:18:52.571625 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:52.572252 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:52.587583 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:52.591888 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.592709 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:52.593152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:52.811059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:52.823500 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:52.825389 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:52.826596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-95ac0404-30ca-4a33-85b1-eff4be19894e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1672 microversion: 2.20 time: 0.259707 Jan 05 18:18:52.827138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 688/1420] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:52 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1672 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:53.104548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:53.105154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:53.111201 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:53.115106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:53.115106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:53.115106 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:53.238814 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:53.246174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d9495e8c-2fbb-4810-96cc-ab5b7769754c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1673 microversion: 2.1 time: 0.145400 Jan 05 18:18:53.246747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 733/1421] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:53 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:53.844943 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:53.845889 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:53.852213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:53.852798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:53.853650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:53.854439 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:53.976660 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:53.985326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:53.986894 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:53.988803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-97d7a0fb-460e-45b3-9520-17a8a4fc1e3f tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1674 microversion: 2.20 time: 0.147132 Jan 05 18:18:53.989442 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 689/1422] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:53 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:54.263800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:54.264324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:54.271093 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:54.271535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:54.272295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:54.272726 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:54.393598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:54.401791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a44ad23f-963c-4058-ac9d-228e2ec470dd tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1673 microversion: 2.1 time: 0.141421 Jan 05 18:18:54.402120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 734/1423] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:54 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1673 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:55.008082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:55.008697 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:55.014566 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:55.015541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:55.015771 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:55.016203 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:55.282467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:55.290313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:55.296921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:55.296921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-96616d61-fcf0-4c1e-843c-b8b83ca90d1e tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.289664 Jan 05 18:18:55.296921 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 690/1424] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:55 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:18:55.419080 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:55.419809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:55.426547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:55.427002 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:55.427779 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:55.428213 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:55.487373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:55.494965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c5e0ef54-4231-4e55-9945-1a7a9ffa5ac9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1606 microversion: 2.1 time: 0.079521 Jan 05 18:18:55.495708 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 735/1425] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:55 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:55.739424 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-cf895387-45de-4476-ba9a-fc6d9d061635 req-f767bd49-1094-430d-be5e-55677b823915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5a3698-19f0-4e99-9fbd-f7d1630b42ab", "name": "network-vif-deleted", "tag": "0dacd42b-f70e-4c6a-b252-dfc171bfd08d"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:18:55.742448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:18:55.742448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:18:55.749393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-cf895387-45de-4476-ba9a-fc6d9d061635 req-f767bd49-1094-430d-be5e-55677b823915 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:55.749837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-cf895387-45de-4476-ba9a-fc6d9d061635 req-f767bd49-1094-430d-be5e-55677b823915 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:55.765081 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-cf895387-45de-4476-ba9a-fc6d9d061635 req-f767bd49-1094-430d-be5e-55677b823915 service nova] Creating event network-vif-deleted:0dacd42b-f70e-4c6a-b252-dfc171bfd08d for instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab on hv-cinder-xena0 Jan 05 18:18:55.770702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-cf895387-45de-4476-ba9a-fc6d9d061635 req-f767bd49-1094-430d-be5e-55677b823915 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036140 Jan 05 18:18:55.772000 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 691/1426] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:18:56.312582 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:56.313208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:56.324924 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:56.325371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:56.326202 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:56.326638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:56.513255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:56.514064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:56.524121 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:56.524572 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:56.525416 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:56.525858 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:56.552904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:56.572880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:56.574735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:56.576601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8715225d-a928-4664-9d6d-5ebfd5319a36 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.268649 Jan 05 18:18:56.577614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 736/1427] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:56 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:56.595246 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:56.596213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:56.600569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:56.652131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:56.661542 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fde46590-8934-4fba-bd54-162c5d9ac6fb tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.152362 Jan 05 18:18:56.670613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 692/1428] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:56 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:18:57.595947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:57.596493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:57.603097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:57.603543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:57.604599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:57.605025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:57.680962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:57.681633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:57.687843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:57.688562 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:57.689072 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:57.690640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:57.732122 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:57.737518 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:57.738598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:57.739047 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:57.743929 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:57.745576 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:57.746872 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ae90a0b2-68f3-4ee4-9f2f-228387e49b88 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.154866 Jan 05 18:18:57.747503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 737/1429] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:57 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:57.782395 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:57.791010 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a434701e-12b0-45e2-aa6e-cabf7f7344bc tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.113703 Jan 05 18:18:57.791806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 693/1430] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:57 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:18:58.764857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:58.765464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:58.771756 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:58.772195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:58.772954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:58.773385 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:58.808427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:58.809037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:58.814999 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:58.815448 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:58.816289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:58.816730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:58.849258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:58.849701 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:58.850186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:18:58.890691 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:58.901486 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-774bf6f8-58ef-4d2f-99d1-9e55912e94b3 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.096895 Jan 05 18:18:58.911897 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 694/1431] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:58 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:18:58.927367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:58.935462 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:58.937045 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:18:58.938333 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7b243b44-78d9-4be2-8a60-edea6836a4ef tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.177116 Jan 05 18:18:58.938974 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 738/1432] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:58 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:18:59.919747 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:59.920368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:59.927001 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:59.930453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:59.930453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:59.930453 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:59.957206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:18:59.957946 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:18:59.964717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:59.965502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:59.966605 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:59.966862 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:18:59.967317 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:59.967706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:18:59.967823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:00.016078 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:00.039191 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-02d5b75b-bbee-4c0d-be77-2b6b639f9bc8 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.122484 Jan 05 18:19:00.048397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 695/1433] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:18:59 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:00.106050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:00.115112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:00.116607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:00.117758 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f41d0652-49df-436e-95e0-076614bd397b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.164856 Jan 05 18:19:00.118361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 739/1434] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:18:59 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:19:01.061950 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:01.063291 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:01.073458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:01.074181 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:01.075156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:01.075755 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:01.117303 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:01.117843 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:01.118505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:01.142717 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:01.145151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:01.159317 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:01.160076 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:01.161190 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:01.161790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:01.167001 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:01.188002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-24620ce6-16fd-472e-b7d8-e5474a8c8706 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.129512 Jan 05 18:19:01.190069 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 696/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:01 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:01.360640 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:01.381511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:01.383136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:01.384334 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-d68eb0a4-8009-4e40-9f76-908b69b179ba tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.245296 Jan 05 18:19:01.384903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 740/1436] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:01 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:02.204475 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:02.205118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:02.211351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:02.211794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:02.212552 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:02.212984 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:02.244881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:02.245329 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:02.245769 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:02.285939 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:02.294286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7aa55616-a12c-4d73-b1e4-356e9a907258 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.093344 Jan 05 18:19:02.295251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 697/1437] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:02 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:02.403765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:02.404312 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:02.411017 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:02.411408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:02.412176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:02.412693 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:02.539680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:02.547424 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:02.548920 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:02.550050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b25806c6-e6ad-4f1d-b28f-7eff4aa9e11a tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.150031 Jan 05 18:19:02.550632 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 741/1438] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:02 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:03.311156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:03.311790 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:03.318463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:03.318967 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:03.319730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:03.320163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:03.351826 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:03.352331 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:03.352818 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:03.396908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:03.405274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-439e6fc6-c030-4f58-9fd4-2f41848d97ea tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.098132 Jan 05 18:19:03.405859 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 698/1439] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:03 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:03.569520 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:03.570152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:03.575991 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:03.576434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:03.577203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:03.577628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:03.706792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:03.715347 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:03.716849 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:03.718036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7a987296-78dd-4360-ac56-64036ee4ddb4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.153091 Jan 05 18:19:03.718610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 742/1440] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:03 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:04.422508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:04.423117 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:04.429657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:04.430245 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:04.431153 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:04.431627 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:04.465323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:04.465778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:04.466276 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:04.512444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:04.520335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5d8ae08b-abda-4854-b312-9b7fdd9d6635 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.101401 Jan 05 18:19:04.520915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 699/1441] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:04 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:04.736535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:04.737119 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:04.743031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:04.743473 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:04.744239 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:04.744667 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:04.871238 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:04.880104 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:04.881615 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:04.882939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1927902e-4f6d-4464-8443-d85df4afca6d tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.150211 Jan 05 18:19:04.886185 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 743/1442] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:04 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:05.537675 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:05.538275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:05.543980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:05.544431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:05.545202 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:05.545637 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:05.574990 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:05.575434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:05.575880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:05.617947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:05.622374 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ae57b5a7-67b7-4255-8f45-c5013d4c6183 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.089034 Jan 05 18:19:05.622940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 700/1443] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:05 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:05.900827 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:05.901367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:05.907006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:05.907448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:05.908203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:05.908631 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:06.025628 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:06.033323 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:06.034841 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:06.036806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ad47233b-f864-444b-b5f8-ae80bb7eb527 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.139754 Jan 05 18:19:06.037365 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 744/1444] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:05 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:06.639450 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:06.640058 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:06.646502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:06.646942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:06.647704 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:06.648129 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:06.677281 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:06.677656 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:06.678120 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:06.716229 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:06.723699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4f618ea4-8e9b-4fef-8789-d9e26dd09aa9 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.087930 Jan 05 18:19:06.724253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 701/1445] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:06 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:07.055310 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:07.055893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:07.061563 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:07.062007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:07.062794 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:07.063223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:07.178926 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:07.186412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:07.187882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:07.189007 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-33e1ded7-fa6e-43b7-8eb7-feb57082b7d6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.138201 Jan 05 18:19:07.189558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 745/1446] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:07 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:07.740372 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:07.740962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:07.747124 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:07.747568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:07.748323 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:07.748752 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:07.779465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:07.779913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:07.780357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:07.819509 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:07.826671 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-82b07cbc-326e-4abb-9137-2ee92b46599d tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.090045 Jan 05 18:19:07.827236 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 702/1447] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:07 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:08.206590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:08.207325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:08.212995 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:08.213437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:08.214223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:08.214656 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:08.334286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:08.341837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:08.343341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:08.344474 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a0a99db7-572d-41c2-954b-2739a0e0b7ff tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.141555 Jan 05 18:19:08.345050 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 746/1448] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:08 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:08.843434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:08.844042 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:08.850811 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:08.851264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:08.852044 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:08.852480 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:08.882856 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:08.883222 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:08.883663 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:08.922600 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:08.930669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-cd86b0d8-d39e-40d0-8160-ae3fcd2c8675 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.091338 Jan 05 18:19:08.931233 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 703/1449] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:08 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:09.362638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:09.363232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:09.369681 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:09.370155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:09.370924 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:09.371354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:09.487791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:09.495939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:09.497440 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:09.498604 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-06ae2075-089f-41cf-beda-4a9783fd9bf8 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.139676 Jan 05 18:19:09.499153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 747/1450] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:09 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:09.946706 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:09.947351 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:09.953159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:09.953672 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:09.954463 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:09.954900 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:09.984168 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:09.984615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:09.985056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lazy-loading 'fault' on Instance uuid cb5a3698-19f0-4e99-9fbd-f7d1630b42ab {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:19:10.023361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a620965de6dd4282ab9f62d66558f8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a115f4527087421fbd282e13ddea7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:10.030851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-25016b78-eec6-4c96-83f7-46b8551b6faa tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 200 len: 1327 microversion: 2.1 time: 0.087955 Jan 05 18:19:10.031419 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 704/1451] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:09 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 1327 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:10.516790 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:10.517390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:10.523744 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:10.524183 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:10.524936 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:10.525371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:10.649480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:10.655602 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:10.657075 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:10.658242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-101de7d1-db6e-4928-9c60-d2bb34ca94bc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.145261 Jan 05 18:19:10.658797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 748/1452] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:10 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:11.047917 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:11.048586 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:11.054390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:11.054846 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:11.055620 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:11.056060 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:11.069182 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. Jan 05 18:19:11.069766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:19:11.070618 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-01182f72-9b98-4531-a8f0-4cb29a7d2e7c tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 404 len: 111 microversion: 2.1 time: 0.026426 Jan 05 18:19:11.071131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 705/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:11 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:19:11.079148 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-562e72f2-aacb-4e2d-b59f-24c3ce033592 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '.version_select at 0x7f734984df70>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:11.164386 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-562e72f2-aacb-4e2d-b59f-24c3ce033592 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893257788" status: 202 len: 0 microversion: 2.1 time: 0.088718 Jan 05 18:19:11.164963 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 749/1454] 10.222.0.26 () {58 vars in 1217 bytes} [Wed Jan 5 18:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893257788 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:19:11.676274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:11.677480 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:11.683188 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:11.683880 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:11.684427 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:11.684891 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:11.828780 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:11.836759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:11.838289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:11.839440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f3ba0c2c-5e28-4f5c-8016-a286d7df6df6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.166908 Jan 05 18:19:11.839997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 706/1455] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:11 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:19:12.857418 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:12.858070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:12.863775 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:12.864805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:12.865652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:12.866116 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:12.984262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:12.992475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:12.993954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:12.995140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-da3d71c1-b8b5-4524-a387-01ae938eeb99 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.141760 Jan 05 18:19:12.995695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 750/1456] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:12 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:14.012657 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:14.013262 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:14.019368 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.023777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.023777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.023777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.143588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:14.152029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:14.153645 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:14.154940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-990fd4d5-0f8a-4011-869d-1568765bebd4 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.146038 Jan 05 18:19:14.156043 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 707/1457] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:14 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:19:14.518477 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:14.519008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:14.524948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.525399 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.526276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.526718 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.540695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. Jan 05 18:19:14.541296 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:19:14.542152 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-7a0969cb-bd97-4ba2-9d83-e4e710ec5b7e tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 404 len: 111 microversion: 2.1 time: 0.027316 Jan 05 18:19:14.546446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 751/1458] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:19:14 2022] DELETE /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:19:14.553757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:14.554395 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: cb5a3698-19f0-4e99-9fbd-f7d1630b42ab] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:14.561349 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.561794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.562624 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:14.563062 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:14.576235 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. Jan 05 18:19:14.576819 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance cb5a3698-19f0-4e99-9fbd-f7d1630b42ab could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:19:14.577662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-289f58a4-561e-414a-803a-81f690c8fbe5 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab" status: 404 len: 111 microversion: 2.1 time: 0.028353 Jan 05 18:19:14.578221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 708/1459] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:14 2022] GET /compute/v2.1/servers/cb5a3698-19f0-4e99-9fbd-f7d1630b42ab => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:19:15.174218 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:15.174830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:15.180675 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.181129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.181904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.182372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.300027 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:15.308364 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:15.311382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:15.311382 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6fe49a47-607e-4383-b86a-e486ad5d1469 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.140559 Jan 05 18:19:15.311722 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 752/1460] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:15 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:15.838860 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:15.839358 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:15.845050 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.845490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.846299 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.846760 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.860467 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. Jan 05 18:19:15.861048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:19:15.861851 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac14b551-3b85-45c4-acbd-da6e560e51f2 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 404 len: 111 microversion: 2.1 time: 0.026706 Jan 05 18:19:15.862397 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 709/1461] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:19:15 2022] DELETE /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:19:15.870558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:15.871162 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] [instance: 43be7c20-103d-483f-99e6-62880b672333] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:15.876893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.877342 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.878147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:15.878585 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:15.891763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] HTTP exception thrown: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. Jan 05 18:19:15.892358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] Returning 404 to user: Instance 43be7c20-103d-483f-99e6-62880b672333 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:19:15.893167 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-3007c1d7-2e9f-46b7-b963-29fa01f27d45 tempest-AttachVolumeTestJSON-1780461115 tempest-AttachVolumeTestJSON-1780461115-project] 10.222.0.26 "GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333" status: 404 len: 111 microversion: 2.1 time: 0.026201 Jan 05 18:19:15.893735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 753/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:15 2022] GET /compute/v2.1/servers/43be7c20-103d-483f-99e6-62880b672333 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:19:16.068609 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-d4601e13-91b9-450a-b748-510663a63163 req-27524158-c2b7-4ed6-a269-972a45cdc4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "name": "network-vif-plugged", "status": "completed", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:16.075699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:19:16.075699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:19:16.077951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d4601e13-91b9-450a-b748-510663a63163 req-27524158-c2b7-4ed6-a269-972a45cdc4c9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:16.078425 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d4601e13-91b9-450a-b748-510663a63163 req-27524158-c2b7-4ed6-a269-972a45cdc4c9 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:16.089751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-d4601e13-91b9-450a-b748-510663a63163 req-27524158-c2b7-4ed6-a269-972a45cdc4c9 service nova] Creating event network-vif-plugged:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:19:16.094779 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-d4601e13-91b9-450a-b748-510663a63163 req-27524158-c2b7-4ed6-a269-972a45cdc4c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Jan 05 18:19:16.095435 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 710/1463] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:19:16.329413 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:16.330112 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:16.337191 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:16.337643 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:16.338459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:16.338895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:16.470354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:16.480352 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:16.481826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:16.483001 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-6df50576-16f8-44db-a162-19c015ac90c6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.157599 Jan 05 18:19:16.483549 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 754/1464] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:16 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 05 18:19:17.502528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:17.503176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:17.509581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:17.510039 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:17.510834 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:17.511269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:17.705920 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:17.714210 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:17.715742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:17.716906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-773ba9a6-8034-49ef-bc40-118bb48011fc tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.218621 Jan 05 18:19:17.717464 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 711/1465] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:17 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:18.735968 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:18.737063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:18.743820 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:18.744339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:18.745084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:18.745707 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:18.958926 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:18.966948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:18.968704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:18.969878 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1f72983d-034c-4ec6-a18a-df2a8dec7bc1 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1730 microversion: 2.20 time: 0.237885 Jan 05 18:19:18.970473 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 755/1466] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:18 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:19.988670 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:19.989902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:19.995766 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:19.996217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:19.996981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:19.997423 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:20.116087 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:20.123912 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:20.125364 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:20.126544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-68187055-1931-4120-a445-ad25a8920418 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1717 microversion: 2.20 time: 0.141745 Jan 05 18:19:20.127289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 712/1467] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:19:19 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1717 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:19:22.889578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1770053192", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "ae2239bc-c53d-43bc-bc2b-cae6951e7ea2"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:22.939599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] validate_networks() for [('ae2239bc-c53d-43bc-bc2b-cae6951e7ea2', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:19:23.263951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:19:23.264371 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:19:23.264847 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:19:23.265254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:19:23.265661 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:19:23.274155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:23.274600 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:23.275400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:23.275830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:23.292423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:19:23.296226 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for user 80c28ef887c64b6ab43e0f58bfa8aea3 and project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:19:23.307118 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:19:23.309359 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:19:23.438180 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b3bd2e6d-28ce-4972-976e-3c9d7fb11319 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662101 Jan 05 18:19:23.438788 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 756/1468] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:19:23.448753 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e673fa78-74cb-4262-9557-42f0e6678112 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:23.449405 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e673fa78-74cb-4262-9557-42f0e6678112 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:23.500875 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e673fa78-74cb-4262-9557-42f0e6678112 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:23.507859 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e673fa78-74cb-4262-9557-42f0e6678112 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1218 microversion: 2.1 time: 0.062624 Jan 05 18:19:23.508496 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 713/1469] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:23 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:24.527896 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:24.528509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:24.534432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:24.534886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:24.535660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:24.536224 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:24.594412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:24.601807 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-774f43c9-bd2d-4557-86dc-875a5f1d8291 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1222 microversion: 2.1 time: 0.077629 Jan 05 18:19:24.602414 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 757/1470] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:24 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:25.619446 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:25.620065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:25.625909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:25.626392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:25.627160 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:25.627626 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:25.686952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:25.694682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-da622614-e310-40ae-86d0-055716cb3139 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1288 microversion: 2.1 time: 0.079000 Jan 05 18:19:25.695249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 714/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:25 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:26.711484 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:26.712120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:26.717786 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:26.718270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:26.719034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:26.719497 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:26.996884 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-13d6112a-f74f-4456-a799-1648b2285f2d req-066795af-8b70-444a-b1af-af72eb5a2f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a34579-8bcd-4497-8864-7a0197b620ac", "tag": "20345e39-42ea-44fa-a4ec-35f8c8af1eba"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:26.998742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:19:26.998742 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:19:27.006770 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-13d6112a-f74f-4456-a799-1648b2285f2d req-066795af-8b70-444a-b1af-af72eb5a2f84 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:27.007336 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-13d6112a-f74f-4456-a799-1648b2285f2d req-066795af-8b70-444a-b1af-af72eb5a2f84 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:27.018970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-13d6112a-f74f-4456-a799-1648b2285f2d req-066795af-8b70-444a-b1af-af72eb5a2f84 service nova] Creating event network-changed:20345e39-42ea-44fa-a4ec-35f8c8af1eba for instance a5a34579-8bcd-4497-8864-7a0197b620ac on hv-cinder-xena0 Jan 05 18:19:27.024640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-13d6112a-f74f-4456-a799-1648b2285f2d req-066795af-8b70-444a-b1af-af72eb5a2f84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Jan 05 18:19:27.025510 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 715/1472] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:19:27.086542 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:27.093791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cb4dfc55-2794-4063-9d97-28dc6c642449 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.386143 Jan 05 18:19:27.094465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 758/1473] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:26 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:28.111564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:28.112258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:28.118815 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:28.119260 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:28.120024 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:28.120456 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:28.243193 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:28.250296 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-00eee68b-7801-4763-bb82-9eaf5cb4062e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.142768 Jan 05 18:19:28.250857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 716/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:28 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:29.267798 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:29.268404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:29.274805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:29.275254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:29.276019 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:29.276457 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:29.391771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:29.399545 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ab9902b4-f9ad-4d2c-a475-4d63008a5dd7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.135447 Jan 05 18:19:29.400108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 759/1475] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:29 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:30.415970 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:30.416581 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:30.422476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:30.422926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:30.423695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:30.424130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:30.546525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:30.554665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5084eac6-553b-427d-b3b0-dfdd1b560154 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.142338 Jan 05 18:19:30.555221 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 717/1476] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:30 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:31.570848 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:31.571450 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:31.577194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:31.577644 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:31.578435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:31.578871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:31.696931 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:31.704084 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-5f82b8dd-e739-4f36-a672-9c247f221229 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.137166 Jan 05 18:19:31.704638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 760/1477] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:31 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:32.217204 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-b6dc0af7-00f8-4949-be89-46823fb10df5 req-0d034c85-34fe-484b-b237-4339f16f5982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a34579-8bcd-4497-8864-7a0197b620ac", "name": "network-vif-plugged", "status": "completed", "tag": "20345e39-42ea-44fa-a4ec-35f8c8af1eba"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:32.218823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:19:32.218823 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:19:32.225669 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b6dc0af7-00f8-4949-be89-46823fb10df5 req-0d034c85-34fe-484b-b237-4339f16f5982 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:32.226168 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-b6dc0af7-00f8-4949-be89-46823fb10df5 req-0d034c85-34fe-484b-b237-4339f16f5982 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:32.237037 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-b6dc0af7-00f8-4949-be89-46823fb10df5 req-0d034c85-34fe-484b-b237-4339f16f5982 service nova] Creating event network-vif-plugged:20345e39-42ea-44fa-a4ec-35f8c8af1eba for instance a5a34579-8bcd-4497-8864-7a0197b620ac on hv-cinder-xena0 Jan 05 18:19:32.241951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-b6dc0af7-00f8-4949-be89-46823fb10df5 req-0d034c85-34fe-484b-b237-4339f16f5982 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028331 Jan 05 18:19:32.242739 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 718/1478] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:19:32.720900 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:32.721504 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:32.727792 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:32.728246 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:32.729028 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:32.729721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:32.850943 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:32.858325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-29b1428a-418d-4c7a-ac95-14dcff7211e1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.141135 Jan 05 18:19:32.858893 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 761/1479] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:32 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:33.876180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:33.876798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:33.883390 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:33.883832 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:33.884588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:33.885020 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:34.005808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:34.012872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6cb183dc-9f8a-4348-9023-9ecbc5b242f1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1318 microversion: 2.1 time: 0.141002 Jan 05 18:19:34.013431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 719/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:33 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:35.029863 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:35.030499 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:35.037284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:35.037730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:35.038550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:35.038969 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:35.156569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:35.164260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-428f5413-acc2-4069-89fc-54d876fbfeeb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1508 microversion: 2.1 time: 0.138049 Jan 05 18:19:35.164825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 762/1481] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:35 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:37.901866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:37.902949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:37.908692 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:37.909142 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:37.909914 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:37.911088 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:38.659525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d3e1f874-8ae9-4b84-9ce9-f30994cd10f6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761224 Jan 05 18:19:38.660138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 720/1482] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:19:37 2022] POST /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:19:47.260467 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1818800976", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "ae2239bc-c53d-43bc-bc2b-cae6951e7ea2"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:47.309261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] validate_networks() for [('ae2239bc-c53d-43bc-bc2b-cae6951e7ea2', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:19:47.654868 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:19:47.655296 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:19:47.655769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:19:47.656178 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:19:47.656586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:19:47.665796 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:47.666284 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:47.667087 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:47.667523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:47.684095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:19:47.687721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for user 80c28ef887c64b6ab43e0f58bfa8aea3 and project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:19:47.698270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:19:47.700422 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:19:47.839876 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0a3c8a9a-3cc0-42b2-afa7-ea29593c6b3a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583019 Jan 05 18:19:47.840528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 763/1483] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:19:47.851932 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-44d96466-ab2a-413d-9176-eab1df5c7e65 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:47.852628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-44d96466-ab2a-413d-9176-eab1df5c7e65 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:47.907021 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-44d96466-ab2a-413d-9176-eab1df5c7e65 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:47.913277 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-44d96466-ab2a-413d-9176-eab1df5c7e65 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1218 microversion: 2.1 time: 0.066689 Jan 05 18:19:47.914269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 721/1484] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:47 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:48.933701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:48.934324 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:48.940934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:48.941652 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:48.942452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:48.942887 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:49.003307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:49.010503 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-44e52c03-337b-4748-a765-81c1cb2e8685 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1214 microversion: 2.1 time: 0.082734 Jan 05 18:19:49.011061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 764/1485] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:48 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:50.027000 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:50.027594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:50.034366 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:50.034951 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:50.035802 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:50.036230 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:50.111424 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:50.119757 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a9f1d364-5a52-4c25-a621-daed5b893182 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1288 microversion: 2.1 time: 0.096395 Jan 05 18:19:50.120338 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 722/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:50 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:51.137232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:51.137780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:51.143464 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:51.143914 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:51.144742 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:51.145378 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:51.271537 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:51.279140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ba08ceca-be44-4c0e-b313-032b070a184d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.145645 Jan 05 18:19:51.289031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 765/1487] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:51 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:51.561575 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-a6aafb56-0ce9-4baf-9c6d-8e89578afabf req-4bc41535-66ea-4399-9cf3-ca2b8c690522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1390585-92ac-49ce-b920-2a504beef96d", "tag": "d9e87733-bf00-4f60-aa65-f1b8885d23dd"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:19:51.563899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:19:51.563899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:19:51.572850 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-a6aafb56-0ce9-4baf-9c6d-8e89578afabf req-4bc41535-66ea-4399-9cf3-ca2b8c690522 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:51.573362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-a6aafb56-0ce9-4baf-9c6d-8e89578afabf req-4bc41535-66ea-4399-9cf3-ca2b8c690522 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:51.584974 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-a6aafb56-0ce9-4baf-9c6d-8e89578afabf req-4bc41535-66ea-4399-9cf3-ca2b8c690522 service nova] Creating event network-changed:d9e87733-bf00-4f60-aa65-f1b8885d23dd for instance a1390585-92ac-49ce-b920-2a504beef96d on hv-cinder-xena0 Jan 05 18:19:51.590258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-a6aafb56-0ce9-4baf-9c6d-8e89578afabf req-4bc41535-66ea-4399-9cf3-ca2b8c690522 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032249 Jan 05 18:19:51.594813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 723/1488] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:19:52.296483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:52.297097 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:52.303488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:52.303947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:52.305231 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:52.305952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:52.429952 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:52.437130 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-072ae7fd-0dfe-42b8-be94-f4ca300f1c06 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.144377 Jan 05 18:19:52.437701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 766/1489] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:52 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:53.454822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:53.455541 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:53.461698 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:53.462171 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:53.462927 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:53.463352 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:53.580941 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:53.588577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6de707ee-bf2e-4449-85e8-27129b786e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.137746 Jan 05 18:19:53.589134 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 724/1490] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:53 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:54.604691 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:54.605299 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:54.610961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:54.611410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:54.612179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:54.612618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:54.730765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:54.737735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-691eea56-6441-4aec-b780-22647dd7c0e2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.136913 Jan 05 18:19:54.738325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 767/1491] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:54 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:55.753808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:55.754916 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:55.761471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:55.761922 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:55.762730 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:55.763166 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:55.884482 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:55.891718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7e6094ca-e058-4ddd-9586-7cfe4e6cb0fc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.141565 Jan 05 18:19:55.892290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 725/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:55 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:56.908772 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:56.909373 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:56.915181 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:56.915624 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:56.916380 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:56.916808 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:57.033206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:57.040979 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b8be29b4-92dc-4cca-92db-315c71856363 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.135827 Jan 05 18:19:57.041543 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 768/1493] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:56 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:58.056906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:58.057516 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:58.063253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:58.063697 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:58.064451 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:58.064881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:58.183444 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:58.190589 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2c54cd1e-51c6-4d83-958e-62ab9b874c46 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.137335 Jan 05 18:19:58.191155 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 726/1494] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:58 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:19:59.208846 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:19:59.209482 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:19:59.215257 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:59.215705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:59.216480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:19:59.216912 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:19:59.336684 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:19:59.343712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-dbc45853-45ed-4f0a-b5cd-a90064b89acd tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.139735 Jan 05 18:19:59.344261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 769/1495] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:19:59 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:00.360782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:00.361506 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:00.367682 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:00.368127 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:00.368893 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:00.369320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:00.375654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-0df10a28-1127-4066-bbc5-b1a064622ae8 req-2ee8583d-7755-4537-ab7f-321e139fbb0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1390585-92ac-49ce-b920-2a504beef96d", "name": "network-vif-plugged", "status": "completed", "tag": "d9e87733-bf00-4f60-aa65-f1b8885d23dd"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:00.377384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:00.377384 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:20:00.386856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-0df10a28-1127-4066-bbc5-b1a064622ae8 req-2ee8583d-7755-4537-ab7f-321e139fbb0e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:00.386856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-0df10a28-1127-4066-bbc5-b1a064622ae8 req-2ee8583d-7755-4537-ab7f-321e139fbb0e service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:00.396529 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-0df10a28-1127-4066-bbc5-b1a064622ae8 req-2ee8583d-7755-4537-ab7f-321e139fbb0e service nova] Creating event network-vif-plugged:d9e87733-bf00-4f60-aa65-f1b8885d23dd for instance a1390585-92ac-49ce-b920-2a504beef96d on hv-cinder-xena0 Jan 05 18:20:00.401857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-0df10a28-1127-4066-bbc5-b1a064622ae8 req-2ee8583d-7755-4537-ab7f-321e139fbb0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 Jan 05 18:20:00.402815 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 770/1496] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:00.497494 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:00.504607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-28843618-c486-4c5f-a987-3fb37eb3b683 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.147542 Jan 05 18:20:00.505410 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 727/1497] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:00 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:01.522658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:01.523374 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:01.529740 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:01.530252 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:01.531028 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:01.531459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:01.654590 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:01.662488 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-bc2b2978-3940-4705-a660-ed8131ef5d8e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.143296 Jan 05 18:20:01.663126 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 771/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:01 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:02.678903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:02.679515 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:02.685269 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:02.685725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:02.686553 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:02.687063 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:02.809094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:02.816249 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ba70f31a-9857-41b5-b7a0-69aede1b2be3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1318 microversion: 2.1 time: 0.141016 Jan 05 18:20:02.816805 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 728/1499] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:02 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:20:03.833309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:03.833927 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:03.840337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:03.840780 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:03.841574 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:03.842006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:03.960175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:03.967489 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1d0a91c8-aace-4e79-8a98-ee6e866c7e55 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1508 microversion: 2.1 time: 0.137767 Jan 05 18:20:03.968055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 772/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:03 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:03.984301 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:03.985342 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:03.992128 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:03.992569 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:03.993327 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:03.993765 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:04.072949 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Invalid volume: volume 8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5 is already attached to instances: a5a34579-8bcd-4497-8864-7a0197b620ac Jan 05 18:20:04.073539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 400 to user: Invalid volume: volume 8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5 is already attached to instances: a5a34579-8bcd-4497-8864-7a0197b620ac {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:04.074391 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-63ac6738-dba8-40d1-84b1-1569f153597d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093869 Jan 05 18:20:04.074926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 729/1501] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:20:03 2022] POST /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:04.136335 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:04.136826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:04.142469 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:04.142911 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:04.143666 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:04.144095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:04.227486 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'services' on Instance uuid a5a34579-8bcd-4497-8864-7a0197b620ac {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:20:04.423842 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-90adeef0-3a32-44ec-8036-444a0f35e23b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments/8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5" status: 202 len: 0 microversion: 2.1 time: 0.290836 Jan 05 18:20:04.424435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 773/1502] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:20:04 2022] DELETE /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments/8480c4b2-fe88-4b7d-b55a-78ad67e2e1f5 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:20:04.433418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:04.434298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:04.441064 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:04.441518 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:04.442334 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:04.442774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:04.472614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b077d9d9-acf0-4b90-bbe8-a2abb10c4432 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Jan 05 18:20:04.473175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 730/1503] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:04 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:05.484865 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:05.485855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:05.492547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:05.492992 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:05.493748 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:05.494206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:05.522037 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4cf07250-c53e-4738-8c44-aba8f9818371 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041136 Jan 05 18:20:05.522573 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 774/1504] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:05 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:06.533347 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:06.534296 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:06.540829 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:06.541286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:06.542091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:06.542531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:06.569940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a8b90fe5-0dad-40f5-919b-d16f7836480f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040383 Jan 05 18:20:06.570520 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 731/1505] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:06 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:20:06.673880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1762994054", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "ae2239bc-c53d-43bc-bc2b-cae6951e7ea2"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:06.724061 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] validate_networks() for [('ae2239bc-c53d-43bc-bc2b-cae6951e7ea2', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:20:07.078881 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:20:07.079306 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:20:07.079771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:20:07.080174 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:20:07.080606 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:20:07.089250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:07.089700 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:07.090535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:07.090961 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:07.107663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:20:07.111383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for user 80c28ef887c64b6ab43e0f58bfa8aea3 and project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:20:07.122164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:20:07.124383 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:20:07.284819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e2881ae0-6efb-49b2-a54e-0098a0bce5f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614600 Jan 05 18:20:07.285393 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 775/1506] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:20:07.295075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-28e44afc-be4c-47d2-b744-4a547a4abf09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:07.295789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-28e44afc-be4c-47d2-b744-4a547a4abf09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:07.346211 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-28e44afc-be4c-47d2-b744-4a547a4abf09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:07.353261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-28e44afc-be4c-47d2-b744-4a547a4abf09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1218 microversion: 2.1 time: 0.061877 Jan 05 18:20:07.353847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 732/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:07 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:20:08.370702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:08.371427 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:08.377278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:08.377732 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:08.378603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:08.379090 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:08.446360 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:08.453570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cd2b7056-2374-48f6-b3f2-10a17fbf2920 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1214 microversion: 2.1 time: 0.086664 Jan 05 18:20:08.454247 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 776/1508] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:08 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:09.470495 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:09.471083 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:09.478461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:09.478461 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:09.478677 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:09.479100 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:09.543116 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:09.550559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-71775ce1-d3f0-4d9c-aac9-d589d3af2c78 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1276 microversion: 2.1 time: 0.083707 Jan 05 18:20:09.551059 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 733/1509] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:09 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:10.567704 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:10.568401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:10.574712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:10.575155 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:10.575918 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:10.576348 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:10.697249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:10.704392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-333932a3-ec90-4165-a670-db27ba01e160 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.140363 Jan 05 18:20:10.706882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 777/1510] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:10 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:10.772292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-4b9a7c64-fc91-4d81-9e40-20525f80ec6d req-3c21a446-3243-40ae-b355-62145d1f6c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb54b6e-3534-4691-a349-fb0d007e11a6", "tag": "06b80582-0466-4e37-8870-ce3522239bab"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:10.773855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:10.773855 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:20:10.781274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-4b9a7c64-fc91-4d81-9e40-20525f80ec6d req-3c21a446-3243-40ae-b355-62145d1f6c66 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:10.781723 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-4b9a7c64-fc91-4d81-9e40-20525f80ec6d req-3c21a446-3243-40ae-b355-62145d1f6c66 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:10.792910 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-4b9a7c64-fc91-4d81-9e40-20525f80ec6d req-3c21a446-3243-40ae-b355-62145d1f6c66 service nova] Creating event network-changed:06b80582-0466-4e37-8870-ce3522239bab for instance 0eb54b6e-3534-4691-a349-fb0d007e11a6 on hv-cinder-xena0 Jan 05 18:20:10.797628 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-4b9a7c64-fc91-4d81-9e40-20525f80ec6d req-3c21a446-3243-40ae-b355-62145d1f6c66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029011 Jan 05 18:20:10.798247 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 734/1511] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:11.721397 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:11.722038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:11.728057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:11.728502 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:11.729288 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:11.729972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:11.995208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:12.002309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-92a31ba3-8aba-4129-afec-f015a73ff47f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.284486 Jan 05 18:20:12.002862 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 778/1512] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:11 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:13.019040 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:13.019736 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:13.025740 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:13.026217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:13.026980 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:13.027409 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:13.150531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:13.157667 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-c5dcd5c9-e361-4c94-b403-ed06579e3244 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.142599 Jan 05 18:20:13.158186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 735/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:13 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:14.174111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:14.174725 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:14.180480 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:14.180949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:14.181715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:14.182217 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:14.305836 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:14.313171 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-2cc0a232-2df6-44d2-802f-4036e5449a6c tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.142756 Jan 05 18:20:14.313736 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 779/1514] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:14 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:15.330348 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:15.330943 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:15.337293 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:15.337750 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:15.338535 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:15.338972 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:15.454056 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:15.461206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3b9da4c6-c186-4a04-98de-738f389e4f1e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.134594 Jan 05 18:20:15.462518 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 736/1515] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:15 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:16.479102 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:16.480295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:16.486208 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:16.486662 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:16.487432 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:16.487870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:16.609315 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:16.613648 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-39f46238-163d-403e-bf4b-377a0fd40084 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.138807 Jan 05 18:20:16.614233 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 780/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:16 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:17.630945 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:17.631590 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:17.638603 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:17.639053 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:17.639824 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:17.640258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:17.756219 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:17.764240 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-6ce95ad6-39b8-460b-b6be-e6aabba8a9d0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.136974 Jan 05 18:20:17.764795 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 737/1517] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:17 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:18.446715 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-c64d2609-73fe-490d-809f-aa1e208aa329 req-03e0806e-955a-42a0-9e50-3bb366003b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb54b6e-3534-4691-a349-fb0d007e11a6", "name": "network-vif-plugged", "status": "completed", "tag": "06b80582-0466-4e37-8870-ce3522239bab"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:18.448402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:18.448402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:20:18.455077 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-c64d2609-73fe-490d-809f-aa1e208aa329 req-03e0806e-955a-42a0-9e50-3bb366003b5b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:18.455516 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-c64d2609-73fe-490d-809f-aa1e208aa329 req-03e0806e-955a-42a0-9e50-3bb366003b5b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:18.466654 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-c64d2609-73fe-490d-809f-aa1e208aa329 req-03e0806e-955a-42a0-9e50-3bb366003b5b service nova] Creating event network-vif-plugged:06b80582-0466-4e37-8870-ce3522239bab for instance 0eb54b6e-3534-4691-a349-fb0d007e11a6 on hv-cinder-xena0 Jan 05 18:20:18.471723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-c64d2609-73fe-490d-809f-aa1e208aa329 req-03e0806e-955a-42a0-9e50-3bb366003b5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 Jan 05 18:20:18.472328 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 781/1518] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:18.781026 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:18.781564 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:18.787216 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:18.787662 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:18.788417 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:18.788841 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:18.925598 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:18.933157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-97dee52e-9cc5-4bec-b8cb-2528345f16f4 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.155956 Jan 05 18:20:18.933714 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 738/1519] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:18 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:19.950500 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:19.951188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:19.957176 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:19.957623 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:19.958408 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:19.958837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:20.078578 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:20.085870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df053021-1964-459f-80a7-064c3a8e01ee tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1318 microversion: 2.1 time: 0.139451 Jan 05 18:20:20.087223 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 782/1520] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:19 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:21.103039 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:21.103870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:21.110649 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:21.111075 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:21.111854 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:21.112286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:21.241343 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:21.254538 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9640ac6c-6515-4302-b24c-42a1f60c0b4a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1507 microversion: 2.1 time: 0.155657 Jan 05 18:20:21.255159 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 739/1521] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:21 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:23.950114 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f4c753-8439-4069-a3f9-1f950553605c"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:23.951173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:23.956789 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:23.957241 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:23.958003 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:23.958459 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:24.696747 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-81b93510-0faf-44b6-861f-039c1a577ddb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750077 Jan 05 18:20:24.697341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 783/1522] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:20:23 2022] POST /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:33.256312 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88f4c753-8439-4069-a3f9-1f950553605c"}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:33.257400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:33.263253 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.263707 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.264476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.264918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.344535 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Invalid volume: volume 88f4c753-8439-4069-a3f9-1f950553605c is already attached to instances: 0eb54b6e-3534-4691-a349-fb0d007e11a6 Jan 05 18:20:33.345138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 400 to user: Invalid volume: volume 88f4c753-8439-4069-a3f9-1f950553605c is already attached to instances: 0eb54b6e-3534-4691-a349-fb0d007e11a6 {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:33.345969 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-dbff5042-7040-4867-a7d2-e7d637ce72e9 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093486 Jan 05 18:20:33.346565 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 740/1523] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:20:33 2022] POST /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:33.409965 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:33.410523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:33.418113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.418568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.419339 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.419773 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.500856 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'services' on Instance uuid 0eb54b6e-3534-4691-a349-fb0d007e11a6 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:20:33.671081 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-414397b8-3b42-42c1-a31b-7fbafb148538 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments/88f4c753-8439-4069-a3f9-1f950553605c" status: 202 len: 0 microversion: 2.1 time: 0.265488 Jan 05 18:20:33.671738 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 784/1524] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:20:33 2022] DELETE /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments/88f4c753-8439-4069-a3f9-1f950553605c => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:20:33.679866 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:33.680837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:33.687332 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.687785 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.688567 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:33.689003 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:33.719650 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-7fd09969-d66c-46b1-9f1f-3514f0102769 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Jan 05 18:20:33.720195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 741/1525] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:33 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:34.732845 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:34.733809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:34.739762 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:34.740205 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:34.740960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:34.741387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:34.769139 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-abdcd76c-7e33-4acf-9833-ea3e524c88db tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041521 Jan 05 18:20:34.769663 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 785/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:34 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:35.780592 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:35.781508 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:35.787469 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:35.787940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:35.788734 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:35.789163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:35.816936 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-3a3fc5fa-8491-4209-b2b2-382ffad0c351 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040418 Jan 05 18:20:35.817487 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 742/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:20:35 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:20:35.922579 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-507196288", "imageRef": "73f25e71-777f-41c7-b856-6be602315d3a", "flavorRef": "452", "networks": [{"uuid": "ae2239bc-c53d-43bc-bc2b-cae6951e7ea2"}]}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:35.973782 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.network.neutron [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] validate_networks() for [('ae2239bc-c53d-43bc-bc2b-cae6951e7ea2', None, None, None, None, None)] {{(pid=116428) validate_networks /opt/stack/nova/nova/network/neutron.py:2481}} Jan 05 18:20:36.340423 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 05 18:20:36.340880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image limits 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 05 18:20:36.341361 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Flavor pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 05 18:20:36.341776 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Image pref 0:0:0 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 05 18:20:36.342220 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.virt.hardware [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116428) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 05 18:20:36.350612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:36.351064 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:36.351871 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:36.352309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:36.368805 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 05 18:20:36.372823 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.quota [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Getting quotas for user 80c28ef887c64b6ab43e0f58bfa8aea3 and project f795b1200ebb4c23a529d7de626eeeca. Resources: {'cores', 'instances', 'ram'} {{(pid=116428) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 05 18:20:36.383419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Going to run 1 instances... {{(pid=116428) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 05 18:20:36.385660 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='73f25e71-777f-41c7-b856-6be602315d3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116428) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 05 18:20:36.525309 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f8852185-a7b5-48d6-b6bc-5fb119c267e3 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606230 Jan 05 18:20:36.525940 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 786/1528] 10.222.0.26 () {60 vars in 1146 bytes} [Wed Jan 5 18:20:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 05 18:20:36.535937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac7292d6-c8f1-42e0-ad6d-5efb41e730b0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:36.540254 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac7292d6-c8f1-42e0-ad6d-5efb41e730b0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:36.588354 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ac7292d6-c8f1-42e0-ad6d-5efb41e730b0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:36.595032 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac7292d6-c8f1-42e0-ad6d-5efb41e730b0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1217 microversion: 2.1 time: 0.062867 Jan 05 18:20:36.595596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 743/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:36 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:36.981598 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:36.982828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:36.989189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:36.989635 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:36.990446 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:36.990880 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.018771 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1b2d70fc-2cf0-427c-b03b-e5bd7e8b70fb tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042022 Jan 05 18:20:37.019248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 787/1530] 10.222.0.26 () {60 vars in 1342 bytes} [Wed Jan 5 18:20:36 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:20:37.077998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:37.078528 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:37.084242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.084686 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.085454 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.085892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.110717 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:20:37.329728 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-94d114fc-18f8-40cd-a984-280a5c12dd9b tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 204 len: 0 microversion: 2.20 time: 0.255126 Jan 05 18:20:37.334176 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 744/1531] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jan 5 18:20:37 2022] DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 05 18:20:37.338412 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:37.339512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:37.345235 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.345679 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.346481 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.346916 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.466270 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:37.473891 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:37.475411 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:37.476558 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-1da58221-d53d-45fb-9d49-0d5ea677b93c tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.141953 Jan 05 18:20:37.477115 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 788/1532] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:37 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:20:37.612135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:37.612845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:37.619335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.619789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.620678 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:37.621286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:37.681150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:37.689025 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a4988311-646c-4de2-9925-3c800c3670e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1213 microversion: 2.1 time: 0.080830 Jan 05 18:20:37.689604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 745/1533] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:37 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:38.494857 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:38.496151 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:38.501942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:38.502416 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:38.503175 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:38.503603 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:38.629737 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:38.637932 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:38.639456 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:38.640607 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-14447af0-367b-454d-bb26-8ee772f86670 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.149506 Jan 05 18:20:38.641153 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 789/1534] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:38 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:20:38.706421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:38.707031 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:38.712777 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:38.713213 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:38.714559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:38.714993 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:38.774722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:38.783183 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-5c2f4129-02c3-49f7-9e78-3235644efe3f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1269 microversion: 2.1 time: 0.080359 Jan 05 18:20:38.787034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 746/1535] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:38 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:39.658828 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:39.659436 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:39.665125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:39.665895 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:39.666882 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:39.667538 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:39.797983 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:39.804519 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:39.805782 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:39.808935 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:39.810765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:39.811948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-75734f23-653c-4ce3-bd71-aa987376cc96 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.156980 Jan 05 18:20:39.812536 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 790/1536] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:39 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:20:39.812898 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:39.813484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:39.814295 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:39.814725 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:40.392611 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:40.399776 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e593a16a-3484-4922-a6ac-ab2de2f1e250 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.602388 Jan 05 18:20:40.400333 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 747/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:39 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:40.829680 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:40.830341 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:40.836613 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:40.837059 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:40.837838 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:40.838301 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:40.959426 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:40.969400 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:40.970931 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:40.972194 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-65373898-d675-4b73-8f63-7afc2fdf81fd tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1723 microversion: 2.20 time: 0.146234 Jan 05 18:20:40.972751 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 791/1538] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:40 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:20:41.084077 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-f024ce98-e192-4b3e-8210-2ee3506fd1f1 req-eebe9aca-155a-4e7a-ab51-724b5213862b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0857e2f4-00b0-491c-8225-4f963c85dac6", "tag": "b81b4f1c-b8d0-4f75-b66e-c996ad37812e"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:41.085768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:41.085768 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:20:41.093822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f024ce98-e192-4b3e-8210-2ee3506fd1f1 req-eebe9aca-155a-4e7a-ab51-724b5213862b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:41.094375 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-f024ce98-e192-4b3e-8210-2ee3506fd1f1 req-eebe9aca-155a-4e7a-ab51-724b5213862b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:41.106163 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-f024ce98-e192-4b3e-8210-2ee3506fd1f1 req-eebe9aca-155a-4e7a-ab51-724b5213862b service nova] Creating event network-changed:b81b4f1c-b8d0-4f75-b66e-c996ad37812e for instance 0857e2f4-00b0-491c-8225-4f963c85dac6 on hv-cinder-xena0 Jan 05 18:20:41.111251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-f024ce98-e192-4b3e-8210-2ee3506fd1f1 req-eebe9aca-155a-4e7a-ab51-724b5213862b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030849 Jan 05 18:20:41.111962 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 748/1539] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:20:41.416701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:41.419611 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:41.425434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:41.426706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:41.428005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:41.428614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:41.576809 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:41.584541 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-34e3c629-9399-454d-b3b5-7f28bf3a25b7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.171474 Jan 05 18:20:41.587430 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 792/1540] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:41 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:41.991938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:41.992915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:41.999845 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:42.000290 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:42.001066 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:42.001502 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:42.032587 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:42.033036 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:42.033484 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lazy-loading 'fault' on Instance uuid 0237b7dd-8018-4706-b3fa-4156d3629d88 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:20:42.080112 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:42.088061 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:42.091094 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '122b92afbf58464aba1dcc7a91e9772b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b91be5b55b454af7a9f0f161ad064f64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:42.091959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fc7ac51e-1e57-41c8-9908-ecddf5a639e6 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 200 len: 1371 microversion: 2.20 time: 0.104097 Jan 05 18:20:42.093072 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 749/1541] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:41 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 05 18:20:42.601401 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:42.602008 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:42.608419 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:42.608870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:42.609636 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:42.610098 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:42.728095 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:42.736031 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-13957c7f-0dc4-48b1-9f7e-7cbdbbdc1ae6 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.138384 Jan 05 18:20:42.736583 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 793/1542] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:42 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:43.111608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:43.112125 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:43.117915 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:43.118392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:43.119157 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:43.119602 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:43.126833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-056ca56a-f4c9-4fb9-9605-1624038754f4 req-c7c3d446-1b8f-46f4-8b64-e35f00ceecef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0237b7dd-8018-4706-b3fa-4156d3629d88", "name": "network-vif-deleted", "tag": "3862f2af-2eb2-47cb-a73f-7af077906f10"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:43.128367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:43.128367 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:20:43.133208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. Jan 05 18:20:43.133798 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:43.134661 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-54f30f60-177f-46cf-a274-1f9184888575 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 404 len: 111 microversion: 2.20 time: 0.026824 Jan 05 18:20:43.134949 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-056ca56a-f4c9-4fb9-9605-1624038754f4 req-c7c3d446-1b8f-46f4-8b64-e35f00ceecef service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:43.135195 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 750/1543] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:43 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:43.135391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-056ca56a-f4c9-4fb9-9605-1624038754f4 req-c7c3d446-1b8f-46f4-8b64-e35f00ceecef service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:43.142897 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-da161dcd-a831-440b-adca-942630371048 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '.version_select at 0x7f73446fd8b0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:43.147455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-056ca56a-f4c9-4fb9-9605-1624038754f4 req-c7c3d446-1b8f-46f4-8b64-e35f00ceecef service nova] Creating event network-vif-deleted:3862f2af-2eb2-47cb-a73f-7af077906f10 for instance 0237b7dd-8018-4706-b3fa-4156d3629d88 on hv-cinder-xena0 Jan 05 18:20:43.152387 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-056ca56a-f4c9-4fb9-9605-1624038754f4 req-c7c3d446-1b8f-46f4-8b64-e35f00ceecef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029041 Jan 05 18:20:43.153146 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 794/1544] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:20:43.216394 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-da161dcd-a831-440b-adca-942630371048 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163944905" status: 204 len: 0 microversion: 2.20 time: 0.076802 Jan 05 18:20:43.216963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 751/1545] 10.222.0.26 () {60 vars in 1261 bytes} [Wed Jan 5 18:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163944905 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 05 18:20:43.752800 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:43.753410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:43.759358 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:43.759810 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:43.761172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:43.761610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:43.960272 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:43.968091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-61b5561c-ac2b-4791-aed5-86cbefc7686a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.219243 Jan 05 18:20:43.968664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 795/1546] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:43 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:44.984293 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:44.984942 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:44.990789 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:44.991237 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:44.992512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:44.992512 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:45.111505 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:45.118659 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-62caf959-0d6e-4818-accb-8e9abe47d24d tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.138052 Jan 05 18:20:45.119207 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 752/1547] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:44 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:45.284402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:45.284902 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:45.290567 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:45.291012 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:45.292276 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:45.293136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:45.305826 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. Jan 05 18:20:45.306437 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:45.307237 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f38fc915-f786-46e8-907c-fa836a5ca6e5 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 404 len: 111 microversion: 2.20 time: 0.026507 Jan 05 18:20:45.308716 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 796/1548] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jan 5 18:20:45 2022] DELETE /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:45.316217 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:45.316817 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 0237b7dd-8018-4706-b3fa-4156d3629d88] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:45.322584 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:45.323091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:45.323857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:45.324289 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:45.336767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. Jan 05 18:20:45.337342 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 0237b7dd-8018-4706-b3fa-4156d3629d88 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:45.338164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-e5133a27-a289-4a34-ad00-462743d87954 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88" status: 404 len: 111 microversion: 2.20 time: 0.025595 Jan 05 18:20:45.338695 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 753/1549] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:45 2022] GET /compute/v2.1/servers/0237b7dd-8018-4706-b3fa-4156d3629d88 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:46.136048 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:46.136372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:46.142448 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.142904 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.143677 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.144113 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.262509 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:46.269610 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-74ca719e-d867-498c-957d-9da30977fbfe tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.137632 Jan 05 18:20:46.270254 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 797/1550] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:46 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:46.574607 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:46.575152 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:46.580773 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.582218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.582218 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.582533 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.596065 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. Jan 05 18:20:46.596614 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:46.597418 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-63be5630-dfca-49a4-9459-6d0b27d652e7 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 404 len: 111 microversion: 2.20 time: 0.027286 Jan 05 18:20:46.597972 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 754/1551] 10.222.0.26 () {60 vars in 1279 bytes} [Wed Jan 5 18:20:46 2022] DELETE /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:46.606221 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:46.611275 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] [instance: 75a21fb6-f469-48ac-81fb-ed035fec00b8] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:46.612689 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.613144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.613925 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:46.614389 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:46.627905 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] HTTP exception thrown: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. Jan 05 18:20:46.628439 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] Returning 404 to user: Instance 75a21fb6-f469-48ac-81fb-ed035fec00b8 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:20:46.629330 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-a9880b1a-210e-4f05-a79f-90dbc152d8e3 tempest-AttachVolumeShelveTestJSON-2126838366 tempest-AttachVolumeShelveTestJSON-2126838366-project] 10.222.0.26 "GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8" status: 404 len: 111 microversion: 2.20 time: 0.027294 Jan 05 18:20:46.630055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 798/1552] 10.222.0.26 () {60 vars in 1276 bytes} [Wed Jan 5 18:20:46 2022] GET /compute/v2.1/servers/75a21fb6-f469-48ac-81fb-ed035fec00b8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:20:47.286180 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:47.286712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:47.293175 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:47.293926 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:47.295025 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:47.295681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:47.435110 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:47.442231 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9e692657-4b14-43ce-af05-7d535090ba76 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.159879 Jan 05 18:20:47.442821 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 755/1553] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:47 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:48.459232 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:48.459833 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:48.466797 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:48.467249 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:48.468069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:48.468501 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:48.715307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:48.723289 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9848408d-42e8-4f00-b78a-2bfc893310ec tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.267709 Jan 05 18:20:48.723855 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 799/1554] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:48 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:49.740840 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:49.741471 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:49.748641 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:49.749091 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:49.750395 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:49.750395 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:49.891472 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:49.899320 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ec3d2787-00ed-40e6-a87a-e82b6f6e9b38 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.158201 Jan 05 18:20:49.900434 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 756/1555] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:49 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:20:50.663730 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-710fde1a-e255-4f0e-a74f-7714845bc384 req-d891d7a9-0bc8-443a-99a6-47ce3f811d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0857e2f4-00b0-491c-8225-4f963c85dac6", "name": "network-vif-plugged", "status": "completed", "tag": "b81b4f1c-b8d0-4f75-b66e-c996ad37812e"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:50.665259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:20:50.665259 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:20:50.673404 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-710fde1a-e255-4f0e-a74f-7714845bc384 req-d891d7a9-0bc8-443a-99a6-47ce3f811d34 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:50.673850 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-710fde1a-e255-4f0e-a74f-7714845bc384 req-d891d7a9-0bc8-443a-99a6-47ce3f811d34 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:50.685614 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-710fde1a-e255-4f0e-a74f-7714845bc384 req-d891d7a9-0bc8-443a-99a6-47ce3f811d34 service nova] Creating event network-vif-plugged:b81b4f1c-b8d0-4f75-b66e-c996ad37812e for instance 0857e2f4-00b0-491c-8225-4f963c85dac6 on hv-cinder-xena0 Jan 05 18:20:50.690523 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-710fde1a-e255-4f0e-a74f-7714845bc384 req-d891d7a9-0bc8-443a-99a6-47ce3f811d34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 Jan 05 18:20:50.691103 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 800/1556] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:20:50.917550 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:50.918251 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:50.924198 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:50.924664 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:50.925455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:50.925937 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:51.103135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:51.110828 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac583f27-1bcc-494c-bfa0-d8fec072e876 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.197936 Jan 05 18:20:51.111392 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 757/1557] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:50 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:52.128025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:52.128713 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:52.134939 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:52.135381 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:52.136533 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:52.136972 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:52.257196 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:52.264478 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8bfda8a8-c829-4f75-95e9-ffd6eba9a128 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1317 microversion: 2.1 time: 0.140552 Jan 05 18:20:52.265038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 801/1558] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:52 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1317 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:53.280398 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:20:53.284759 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:53.286902 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:53.287361 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:53.288097 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:53.288525 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:53.407547 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:20:53.414794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9c993c11-a131-4064-94bd-c5214cd575bf tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1507 microversion: 2.1 time: 0.138119 Jan 05 18:20:53.415345 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 758/1559] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:20:53 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1507 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:20:56.016055 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96fa2d68-ea87-49c0-966a-6656e2f034ab"}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:20:56.017100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:20:56.022735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:56.023189 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:56.023954 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:20:56.024379 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:20:56.753568 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-0a57f0f2-fbb9-4d21-b807-567cc90573bc tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "POST /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741285 Jan 05 18:20:56.754719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 802/1560] 10.222.0.26 () {60 vars in 1322 bytes} [Wed Jan 5 18:20:56 2022] POST /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:04.966499 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:04.967168 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:04.969597 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-9819b304-dc74-470c-996a-7b4bb5c778aa req-22bc0fbc-be18-4932-9ce8-933ea0410fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b67721d-e2c6-4b8a-a742-ec6d95782f6e", "tag": "3d2f98d0-8524-434e-9104-c73e7263cf78"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:04.971141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:04.971141 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:21:04.974104 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:04.974784 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:04.975630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:04.976158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:04.979091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-9819b304-dc74-470c-996a-7b4bb5c778aa req-22bc0fbc-be18-4932-9ce8-933ea0410fc4 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:04.979608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-9819b304-dc74-470c-996a-7b4bb5c778aa req-22bc0fbc-be18-4932-9ce8-933ea0410fc4 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:04.990172 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-9819b304-dc74-470c-996a-7b4bb5c778aa req-22bc0fbc-be18-4932-9ce8-933ea0410fc4 service nova] Creating event network-changed:3d2f98d0-8524-434e-9104-c73e7263cf78 for instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e on hv-cinder-xena0 Jan 05 18:21:04.996325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-9819b304-dc74-470c-996a-7b4bb5c778aa req-22bc0fbc-be18-4932-9ce8-933ea0410fc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030379 Jan 05 18:21:04.996325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 803/1561] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:21:05.006783 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:05.409369 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ac9da646-e483-4ce2-8846-b470d34196a3 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 204 len: 0 microversion: 2.1 time: 0.446788 Jan 05 18:21:05.410298 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 759/1562] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:04 2022] DELETE /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:21:05.422565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:05.422565 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:05.427307 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.427999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.429349 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.430026 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.438255 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:05.439778 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:05.453767 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.454264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.455799 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.456429 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.571640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'services' on Instance uuid 0857e2f4-00b0-491c-8225-4f963c85dac6 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:21:05.593267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:05.601822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-b6a932c9-e858-48f9-a0f6-59db6160ec0e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1575 microversion: 2.1 time: 0.186800 Jan 05 18:21:05.602429 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 804/1563] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:05 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:05.824853 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-9c2fd66c-f602-47bd-82de-e64a766f5d5f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments/96fa2d68-ea87-49c0-966a-6656e2f034ab" status: 202 len: 0 microversion: 2.1 time: 0.392391 Jan 05 18:21:05.825640 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 760/1564] 10.222.0.26 () {58 vars in 1415 bytes} [Wed Jan 5 18:21:05 2022] DELETE /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments/96fa2d68-ea87-49c0-966a-6656e2f034ab => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:21:05.833860 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:05.834806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:05.840616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.841274 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.842105 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:05.842619 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:05.874476 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-66d80557-b5b7-4a79-a031-acb457bddad8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Jan 05 18:21:05.875350 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 805/1565] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:21:05 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:06.621636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:06.621636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:06.626808 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:06.627278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:06.629455 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:06.629903 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:06.792377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:06.792377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b1227dce-7ef5-4b13-beda-ce40f7870897 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1456 microversion: 2.1 time: 0.152555 Jan 05 18:21:06.792377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 761/1566] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:06 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1456 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:06.885948 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:06.889460 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:06.893326 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:06.893799 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:06.894599 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:06.895033 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:06.924449 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-9ef83230-967e-4344-9ea9-a814d929ad09 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 Jan 05 18:21:06.925005 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 806/1567] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:21:06 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:07.807870 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:07.808476 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:07.814362 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:07.814816 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:07.815594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:07.816034 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:07.935769 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:07.937639 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:07.944734 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:07.945261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:07.946091 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:07.946651 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:07.976415 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-10b01b09-4315-49af-8161-98ed3fc058bb tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044744 Jan 05 18:21:07.983695 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 807/1568] 10.222.0.26 () {58 vars in 1301 bytes} [Wed Jan 5 18:21:07 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 05 18:21:08.019847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:08.028164 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2adee380-8d96-47f5-9495-d4108744549e tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1456 microversion: 2.1 time: 0.223965 Jan 05 18:21:08.028899 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 762/1569] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:07 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1456 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:08.284038 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-3320bba3-90b6-4349-92d7-17ec62634937 req-9e9acfd7-80ae-4047-8c0f-5307426933c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b67721d-e2c6-4b8a-a742-ec6d95782f6e", "name": "network-vif-deleted", "tag": "3d2f98d0-8524-434e-9104-c73e7263cf78"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:08.285566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:08.285566 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:21:08.292243 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3320bba3-90b6-4349-92d7-17ec62634937 req-9e9acfd7-80ae-4047-8c0f-5307426933c8 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:08.292687 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3320bba3-90b6-4349-92d7-17ec62634937 req-9e9acfd7-80ae-4047-8c0f-5307426933c8 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:08.304016 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-3320bba3-90b6-4349-92d7-17ec62634937 req-9e9acfd7-80ae-4047-8c0f-5307426933c8 service nova] Creating event network-vif-deleted:3d2f98d0-8524-434e-9104-c73e7263cf78 for instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e on hv-cinder-xena0 Jan 05 18:21:08.309120 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-3320bba3-90b6-4349-92d7-17ec62634937 req-9e9acfd7-80ae-4047-8c0f-5307426933c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 Jan 05 18:21:08.309917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 808/1570] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:09.050827 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:09.055070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:09.057082 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.057539 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.058401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.058837 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.122852 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:09.132631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-053f04ba-01a6-4a73-86ca-1f558a6945ec tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 200 len: 1223 microversion: 2.1 time: 0.086384 Jan 05 18:21:09.140981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 763/1571] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:09 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:09.312475 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:09.313069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:09.319173 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.319840 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.320821 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.321262 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.347024 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Going to try to terminate instance {{(pid=116428) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:09.665825 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-f3eed5b0-2aa5-4fca-ad7c-5d6c2be90724 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 204 len: 0 microversion: 2.1 time: 0.357764 Jan 05 18:21:09.666455 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 809/1572] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:09 2022] DELETE /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:21:09.675814 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:09.676630 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:09.689054 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.689588 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.690774 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:09.691373 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:09.826135 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:09.830357 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-bdafd54f-b960-4b63-8dbc-c43f6f0587a1 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1513 microversion: 2.1 time: 0.159438 Jan 05 18:21:09.830911 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 764/1573] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:09 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:10.150548 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:10.151295 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 9b67721d-e2c6-4b8a-a742-ec6d95782f6e] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:10.157727 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:10.158206 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:10.159004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:10.159435 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:10.173248 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] HTTP exception thrown: Instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e could not be found. Jan 05 18:21:10.176910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Returning 404 to user: Instance 9b67721d-e2c6-4b8a-a742-ec6d95782f6e could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:10.176910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4558e956-79f1-44c4-8d26-09f5ec46c177 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e" status: 404 len: 111 microversion: 2.1 time: 0.028499 Jan 05 18:21:10.176910 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 810/1574] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:10 2022] GET /compute/v2.1/servers/9b67721d-e2c6-4b8a-a742-ec6d95782f6e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:10.847286 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:10.847892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:10.853493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:10.853940 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:10.854729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:10.855414 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:10.976732 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:10.984699 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-570bc7d1-58c6-4165-a347-0dd86daba613 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1513 microversion: 2.1 time: 0.141281 Jan 05 18:21:10.985261 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 765/1575] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:10 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:12.000806 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:12.001465 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:12.007959 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:12.008372 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:12.009147 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:12.009627 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:12.129953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:12.138515 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c1f784df-1dc2-4ae3-8b27-0e8f0623f5e7 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1513 microversion: 2.1 time: 0.141427 Jan 05 18:21:12.139337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 811/1576] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:11 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:12.634404 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-6d609a31-304d-4556-bc39-f381d41e80cb req-7580f889-f369-402e-84af-46c06d63231b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0857e2f4-00b0-491c-8225-4f963c85dac6", "name": "network-vif-deleted", "tag": "b81b4f1c-b8d0-4f75-b66e-c996ad37812e"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:12.636681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:12.636681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:21:12.644325 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6d609a31-304d-4556-bc39-f381d41e80cb req-7580f889-f369-402e-84af-46c06d63231b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:12.644865 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-6d609a31-304d-4556-bc39-f381d41e80cb req-7580f889-f369-402e-84af-46c06d63231b service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:12.656208 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-6d609a31-304d-4556-bc39-f381d41e80cb req-7580f889-f369-402e-84af-46c06d63231b service nova] Creating event network-vif-deleted:b81b4f1c-b8d0-4f75-b66e-c996ad37812e for instance 0857e2f4-00b0-491c-8225-4f963c85dac6 on hv-cinder-xena0 Jan 05 18:21:12.661997 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-6d609a31-304d-4556-bc39-f381d41e80cb req-7580f889-f369-402e-84af-46c06d63231b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031121 Jan 05 18:21:12.662718 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 766/1577] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:13.155280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:13.155907 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:13.162229 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.162721 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.163678 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.163819 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.203069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.204157 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.204688 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'fault' on Instance uuid 0857e2f4-00b0-491c-8225-4f963c85dac6 {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:21:13.254280 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:13.261483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8c14f013-8471-44ba-a39b-a3fd061c50b2 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 200 len: 1307 microversion: 2.1 time: 0.110058 Jan 05 18:21:13.271685 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 812/1578] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:13 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:13.626631 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:13.627293 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:13.629067 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-4ad99fc1-80f0-4c71-a1e9-c626d21794f5 req-6d203a8b-dcdf-4d08-afc3-bd5065c33294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8082cfa-4412-4f34-ba49-ff82c3abef30", "tag": "cc53b920-be82-409d-983b-4ac61b3c409d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:13.630741 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:13.630741 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:21:13.634310 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.634959 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.636490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.637093 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.637945 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-4ad99fc1-80f0-4c71-a1e9-c626d21794f5 req-6d203a8b-dcdf-4d08-afc3-bd5065c33294 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:13.638485 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-4ad99fc1-80f0-4c71-a1e9-c626d21794f5 req-6d203a8b-dcdf-4d08-afc3-bd5065c33294 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:13.653822 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-4ad99fc1-80f0-4c71-a1e9-c626d21794f5 req-6d203a8b-dcdf-4d08-afc3-bd5065c33294 service nova] Creating event network-changed:cc53b920-be82-409d-983b-4ac61b3c409d for instance d8082cfa-4412-4f34-ba49-ff82c3abef30 on hv-cinder-xena0 Jan 05 18:21:13.659725 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-4ad99fc1-80f0-4c71-a1e9-c626d21794f5 req-6d203a8b-dcdf-4d08-afc3-bd5065c33294 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034571 Jan 05 18:21:13.662735 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 813/1579] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:13.664258 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:13.983147 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-ae016ace-d492-49fb-be47-e8cdd5307e9d tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 204 len: 0 microversion: 2.1 time: 0.360896 Jan 05 18:21:13.983872 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 767/1580] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:13 2022] DELETE /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:21:13.993212 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:13.993923 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:14.000286 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:14.000999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:14.001960 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:14.002581 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:14.142337 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:14.150256 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c929148b-3b77-45a2-a55f-371c5e2a55f9 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1574 microversion: 2.1 time: 0.161131 Jan 05 18:21:14.151250 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 814/1581] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:13 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:21:14.280713 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:14.282234 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0857e2f4-00b0-491c-8225-4f963c85dac6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:14.289009 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:14.289938 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:14.290946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:14.291965 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:14.307275 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Instance 0857e2f4-00b0-491c-8225-4f963c85dac6 could not be found. Jan 05 18:21:14.307876 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 404 to user: Instance 0857e2f4-00b0-491c-8225-4f963c85dac6 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:14.308722 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-22b19a79-8ba6-4873-9e6c-8be1e5297e89 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6" status: 404 len: 111 microversion: 2.1 time: 0.032874 Jan 05 18:21:14.309273 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 768/1582] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:14 2022] GET /compute/v2.1/servers/0857e2f4-00b0-491c-8225-4f963c85dac6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:15.168094 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:15.168697 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:15.174425 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.174978 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.175746 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.176179 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.296040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:15.304466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ef5bce52-3189-4be8-b39f-461d58d96393 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1455 microversion: 2.1 time: 0.139993 Jan 05 18:21:15.305040 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 815/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:15 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:15.638531 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:15.639025 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:15.645594 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.646138 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.646909 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.647522 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.671918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:15.835343 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [req-3cbf8b79-a1d5-4b62-bf71-fffb98cf4ffe req-199b6135-842c-437c-b00d-914395db7a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8082cfa-4412-4f34-ba49-ff82c3abef30", "name": "network-vif-deleted", "tag": "cc53b920-be82-409d-983b-4ac61b3c409d"}]} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:15.836859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:15.836859 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: warnings.warn(msg) Jan 05 18:21:15.843584 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3cbf8b79-a1d5-4b62-bf71-fffb98cf4ffe req-199b6135-842c-437c-b00d-914395db7a74 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.844025 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [req-3cbf8b79-a1d5-4b62-bf71-fffb98cf4ffe req-199b6135-842c-437c-b00d-914395db7a74 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.854719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.compute.server_external_events [req-3cbf8b79-a1d5-4b62-bf71-fffb98cf4ffe req-199b6135-842c-437c-b00d-914395db7a74 service nova] Creating event network-vif-deleted:cc53b920-be82-409d-983b-4ac61b3c409d for instance d8082cfa-4412-4f34-ba49-ff82c3abef30 on hv-cinder-xena0 Jan 05 18:21:15.860996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [req-3cbf8b79-a1d5-4b62-bf71-fffb98cf4ffe req-199b6135-842c-437c-b00d-914395db7a74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029396 Jan 05 18:21:15.861580 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 816/1584] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:21:15.941130 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b89e5789-44fc-4305-bf5a-d15989b17dae tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 204 len: 0 microversion: 2.1 time: 0.305717 Jan 05 18:21:15.941724 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 769/1585] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:15 2022] DELETE /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:21:15.955193 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:15.955886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:15.962069 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.962534 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:15.963278 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:15.963706 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:16.089759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:16.097560 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4b5f3f84-5406-450f-839f-3394fc5d7687 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.146807 Jan 05 18:21:16.098140 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 817/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:15 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:16.322918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:16.323610 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:16.330377 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:16.330806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:16.331571 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:16.332016 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:16.392447 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c202797c1440e1beb37e997904ac04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e68392448c4624aa2ae32698c65e8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:16.399259 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-2782e0f8-d310-447d-bf97-53ddbd4eb342 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 200 len: 1223 microversion: 2.1 time: 0.080311 Jan 05 18:21:16.399813 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 770/1587] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:16 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:17.114996 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:17.115618 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:17.121207 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.121657 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.122458 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.122894 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.249938 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:17.257526 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-62dfb3ea-566a-4ba0-9e85-c6b1d2676e70 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.146260 Jan 05 18:21:17.258111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 818/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:17 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:17.415822 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:17.416433 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: d8082cfa-4412-4f34-ba49-ff82c3abef30] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:17.422890 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.423381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.424149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.424579 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.438165 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] HTTP exception thrown: Instance d8082cfa-4412-4f34-ba49-ff82c3abef30 could not be found. Jan 05 18:21:17.438804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Returning 404 to user: Instance d8082cfa-4412-4f34-ba49-ff82c3abef30 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:17.439615 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-db33af62-f60e-4c58-94d2-8440328a46ff tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30" status: 404 len: 111 microversion: 2.1 time: 0.027614 Jan 05 18:21:17.440132 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 771/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:17 2022] GET /compute/v2.1/servers/d8082cfa-4412-4f34-ba49-ff82c3abef30 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:17.935712 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:17.936277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:17.942188 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.942634 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.943452 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.943886 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.957195 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] HTTP exception thrown: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. Jan 05 18:21:17.957770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Returning 404 to user: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:17.958917 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-44c0a891-1ff8-4141-a693-e0ed051df95b tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 404 len: 111 microversion: 2.1 time: 0.026667 Jan 05 18:21:17.959144 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 819/1590] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:17 2022] DELETE /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:17.967326 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:17.967948 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] [instance: 5d49986c-47f7-4efe-ab72-3178533fa6e3] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:17.974465 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.974913 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.975685 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:17.976118 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:17.989350 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] HTTP exception thrown: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. Jan 05 18:21:17.989935 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Returning 404 to user: Instance 5d49986c-47f7-4efe-ab72-3178533fa6e3 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:17.990804 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-0d744517-be6d-4636-98b2-1bb119af5bc0 tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3" status: 404 len: 111 microversion: 2.1 time: 0.027428 Jan 05 18:21:17.993458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 772/1591] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:17 2022] GET /compute/v2.1/servers/5d49986c-47f7-4efe-ab72-3178533fa6e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:18.274723 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:18.275329 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:18.281100 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:18.281550 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:18.283021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:18.283453 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:18.403933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:18.411953 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-4b5977c8-03dc-4450-89b3-c0d6a38e7662 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.140913 Jan 05 18:21:18.412592 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 820/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:18 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 05 18:21:19.428847 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:19.429534 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:19.435206 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:19.435729 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:19.436608 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:19.437046 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:19.556934 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:19.565029 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-410df384-25e3-4c5e-8cf2-0d93215b459b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.139723 Jan 05 18:21:19.565593 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 773/1593] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:19 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:20.582154 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:20.582759 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:20.588933 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:20.589375 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:20.590167 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:20.590625 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:20.711293 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:20.718552 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-ff7b0ef1-e978-4328-98b9-3b6d48713499 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.140684 Jan 05 18:21:20.719108 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 821/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:20 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:21.735274 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:21.735908 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:21.741665 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:21.742149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:21.742910 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:21.743340 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:21.859314 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:21.866857 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-44e3cf94-3e94-40ac-ac73-755e1a9dc831 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.135293 Jan 05 18:21:21.867421 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 774/1595] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:21 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:22.883242 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:22.884034 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:22.889778 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:22.890260 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:22.891029 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:22.891514 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:23.013612 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:23.021021 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c3eb70bc-56ce-4d8c-96a6-8605e6bdde6a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1513 microversion: 2.1 time: 0.141468 Jan 05 18:21:23.021586 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 822/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:22 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:23.217150 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-3d13724e-4dea-4e4f-a6d3-ba9adf947ef4 req-5fc2c07d-5de6-41ec-90f7-734fde7a50d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb54b6e-3534-4691-a349-fb0d007e11a6", "name": "network-vif-deleted", "tag": "06b80582-0466-4e37-8870-ce3522239bab"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:23.218745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:23.218745 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:21:23.226149 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-3d13724e-4dea-4e4f-a6d3-ba9adf947ef4 req-5fc2c07d-5de6-41ec-90f7-734fde7a50d7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:23.226596 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-3d13724e-4dea-4e4f-a6d3-ba9adf947ef4 req-5fc2c07d-5de6-41ec-90f7-734fde7a50d7 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:23.238493 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-3d13724e-4dea-4e4f-a6d3-ba9adf947ef4 req-5fc2c07d-5de6-41ec-90f7-734fde7a50d7 service nova] Creating event network-vif-deleted:06b80582-0466-4e37-8870-ce3522239bab for instance 0eb54b6e-3534-4691-a349-fb0d007e11a6 on hv-cinder-xena0 Jan 05 18:21:23.243633 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-3d13724e-4dea-4e4f-a6d3-ba9adf947ef4 req-5fc2c07d-5de6-41ec-90f7-734fde7a50d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030024 Jan 05 18:21:23.244318 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 775/1597] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:23.759434 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-69f6da8e-d272-4316-a0c4-1f29b9e639cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] Calling method '.version_select at 0x7f734986e700>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:23.849942 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-69f6da8e-d272-4316-a0c4-1f29b9e639cc tempest-TestVolumeBootPattern-2007169196 tempest-TestVolumeBootPattern-2007169196-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-84115276" status: 202 len: 0 microversion: 2.1 time: 0.094207 Jan 05 18:21:23.850601 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 823/1598] 10.222.0.26 () {58 vars in 1256 bytes} [Wed Jan 5 18:21:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-84115276 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 05 18:21:24.037901 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:24.038702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:24.044801 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:24.045308 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:24.054048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:24.054048 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:24.077498 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:24.077946 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:24.078440 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.objects.instance [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'fault' on Instance uuid 0eb54b6e-3534-4691-a349-fb0d007e11a6 {{(pid=116429) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:21:24.140272 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:24.147961 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-d140982c-0ea3-46fb-b428-61d3258fa286 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 200 len: 1308 microversion: 2.1 time: 0.114143 Jan 05 18:21:24.148605 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 776/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:24 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:25.165767 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:25.166493 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: 0eb54b6e-3534-4691-a349-fb0d007e11a6] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:25.173391 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.177658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.177658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.177658 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.190705 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Instance 0eb54b6e-3534-4691-a349-fb0d007e11a6 could not be found. Jan 05 18:21:25.191290 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 404 to user: Instance 0eb54b6e-3534-4691-a349-fb0d007e11a6 could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:25.192136 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-cb08a94f-31d9-4db4-9f78-1d9f818386e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6" status: 404 len: 111 microversion: 2.1 time: 0.030353 Jan 05 18:21:25.192696 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 824/1600] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:25 2022] GET /compute/v2.1/servers/0eb54b6e-3534-4691-a349-fb0d007e11a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:25.200878 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:25.201426 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:25.207764 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.208238 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.209079 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.209532 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.236947 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:25.542881 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-83f50731-e3eb-446b-b2cf-e747e77a747e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 204 len: 0 microversion: 2.1 time: 0.345498 Jan 05 18:21:25.543501 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 777/1601] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:25 2022] DELETE /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 05 18:21:25.551854 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:25.552595 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:25.558528 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.559056 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.559903 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:25.560402 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:25.687884 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:25.700433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-754c4ef0-1695-4af3-a2f2-b970751772e8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1514 microversion: 2.1 time: 0.148184 Jan 05 18:21:25.700433 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 825/1602] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:25 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:26.714906 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:26.715604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:26.724681 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:26.725158 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:26.725952 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:26.726400 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:26.929380 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:26.936918 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-b5bc162b-b47c-4a83-90dd-84aea283cd54 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1514 microversion: 2.1 time: 0.226325 Jan 05 18:21:26.937619 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 778/1603] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:26 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:27.956138 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:27.957609 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:27.965763 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:27.966608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:27.967410 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:27.967919 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:28.259568 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-d12191b6-a0d9-47a2-b578-a33f46432005 req-39167b90-9d52-4c41-8bd3-356c4a4d3ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1390585-92ac-49ce-b920-2a504beef96d", "name": "network-vif-deleted", "tag": "d9e87733-bf00-4f60-aa65-f1b8885d23dd"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:28.263908 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:28.268651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:28.268651 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:21:28.276125 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-df548c91-b96c-4046-936f-0c181ae2cc7e tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 200 len: 1514 microversion: 2.1 time: 0.325594 Jan 05 18:21:28.278951 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 826/1604] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:27 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 1514 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:28.279863 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d12191b6-a0d9-47a2-b578-a33f46432005 req-39167b90-9d52-4c41-8bd3-356c4a4d3ca1 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:28.280371 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-d12191b6-a0d9-47a2-b578-a33f46432005 req-39167b90-9d52-4c41-8bd3-356c4a4d3ca1 service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:28.292313 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-d12191b6-a0d9-47a2-b578-a33f46432005 req-39167b90-9d52-4c41-8bd3-356c4a4d3ca1 service nova] Creating event network-vif-deleted:d9e87733-bf00-4f60-aa65-f1b8885d23dd for instance a1390585-92ac-49ce-b920-2a504beef96d on hv-cinder-xena0 Jan 05 18:21:28.298559 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-d12191b6-a0d9-47a2-b578-a33f46432005 req-39167b90-9d52-4c41-8bd3-356c4a4d3ca1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042538 Jan 05 18:21:28.303194 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 779/1605] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 05 18:21:29.301765 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:29.302431 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a1390585-92ac-49ce-b920-2a504beef96d] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:29.308063 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:29.308511 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:29.309283 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:29.309714 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:29.323546 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Instance a1390585-92ac-49ce-b920-2a504beef96d could not be found. Jan 05 18:21:29.324129 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 404 to user: Instance a1390585-92ac-49ce-b920-2a504beef96d could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:29.324947 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-677edc9f-922d-4164-8aa9-6d5c346a485a tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d" status: 404 len: 111 microversion: 2.1 time: 0.027244 Jan 05 18:21:29.325804 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 827/1606] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:29 2022] GET /compute/v2.1/servers/a1390585-92ac-49ce-b920-2a504beef96d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:30.580013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:30.580617 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:30.586573 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:30.587023 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:30.587803 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:30.588242 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:30.613309 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Going to try to terminate instance {{(pid=116429) delete /opt/stack/nova/nova/compute/api.py:2612}} Jan 05 18:21:30.871393 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-71fde149-ac78-4201-bfc7-694cafb5737b tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 204 len: 0 microversion: 2.1 time: 0.295708 Jan 05 18:21:30.872033 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 780/1607] 10.222.0.26 () {58 vars in 1238 bytes} [Wed Jan 5 18:21:30 2022] DELETE /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 05 18:21:30.880719 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:30.881325 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:30.887166 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:30.887616 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:30.888392 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:30.888830 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:31.014354 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:31.025701 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e12b056b-b545-4cc3-95c1-9454e96dc4e0 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1514 microversion: 2.1 time: 0.148790 Jan 05 18:21:31.026390 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 828/1608] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:30 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:32.043459 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:32.044167 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:32.050156 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:32.050604 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:32.051378 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:32.051810 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:32.176924 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.policy [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116429) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:32.184266 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-381fbf40-2b2c-4f1d-9312-3dfb164b731f tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1514 microversion: 2.1 time: 0.144844 Jan 05 18:21:32.185070 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 781/1609] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:32 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:33.201494 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:33.205999 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:33.208570 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:33.209111 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:33.210057 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:33.210569 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:33.362203 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:33.369483 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e186cb2d-e86e-4da5-8539-d1225a3d2379 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1514 microversion: 2.1 time: 0.171796 Jan 05 18:21:33.370066 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 829/1610] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:33 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:33.549490 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [req-900c690f-acdf-4de1-a8b2-cd36b749ce2e req-4b91d229-6df6-4c97-9150-11adf7c811bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a34579-8bcd-4497-8864-7a0197b620ac", "name": "network-vif-deleted", "tag": "20345e39-42ea-44fa-a4ec-35f8c8af1eba"}]} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:33.551111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 05 18:21:33.551111 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: warnings.warn(msg) Jan 05 18:21:33.557712 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-900c690f-acdf-4de1-a8b2-cd36b749ce2e req-4b91d229-6df6-4c97-9150-11adf7c811bc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:33.558197 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [req-900c690f-acdf-4de1-a8b2-cd36b749ce2e req-4b91d229-6df6-4c97-9150-11adf7c811bc service nova] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:33.568710 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.compute.server_external_events [req-900c690f-acdf-4de1-a8b2-cd36b749ce2e req-4b91d229-6df6-4c97-9150-11adf7c811bc service nova] Creating event network-vif-deleted:20345e39-42ea-44fa-a4ec-35f8c8af1eba for instance a5a34579-8bcd-4497-8864-7a0197b620ac on hv-cinder-xena0 Jan 05 18:21:33.573401 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [req-900c690f-acdf-4de1-a8b2-cd36b749ce2e req-4b91d229-6df6-4c97-9150-11adf7c811bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028267 Jan 05 18:21:33.573985 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 782/1611] 10.222.0.26 () {64 vars in 1317 bytes} [Wed Jan 5 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 05 18:21:34.385277 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:34.385873 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.compute.api [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116428) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:34.392547 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:34.393006 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:34.393791 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:34.394268 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:34.424608 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:34.425060 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG oslo_concurrency.lockutils [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:34.425512 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.objects.instance [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lazy-loading 'fault' on Instance uuid a5a34579-8bcd-4497-8864-7a0197b620ac {{(pid=116428) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Jan 05 18:21:34.464070 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.policy [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80c28ef887c64b6ab43e0f58bfa8aea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f795b1200ebb4c23a529d7de626eeeca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116428) authorize /opt/stack/nova/nova/policy.py:199}} Jan 05 18:21:34.471466 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-c7595f1b-e069-4fb8-ba08-414648b7f0d8 tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 200 len: 1308 microversion: 2.1 time: 0.089961 Jan 05 18:21:34.472036 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 830/1612] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:34 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 05 18:21:35.488131 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Calling method '>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:35.488854 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.compute.api [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] [instance: a5a34579-8bcd-4497-8864-7a0197b620ac] Fetching instance by UUID {{(pid=116429) get /opt/stack/nova/nova/compute/api.py:2863}} Jan 05 18:21:35.494994 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:35.495431 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:35.496186 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jan 05 18:21:35.496613 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG oslo_concurrency.lockutils [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Lock "1bc56a97-2ac7-468b-8bd7-5b98997e3080" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jan 05 18:21:35.511278 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] HTTP exception thrown: Instance a5a34579-8bcd-4497-8864-7a0197b620ac could not be found. Jan 05 18:21:35.511892 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] Returning 404 to user: Instance a5a34579-8bcd-4497-8864-7a0197b620ac could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:35.512702 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-f2d18f7f-7778-4b28-88d6-34cc7a0d62ba tempest-AttachVolumeNegativeTest-520508494 tempest-AttachVolumeNegativeTest-520508494-project] 10.222.0.26 "GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac" status: 404 len: 111 microversion: 2.1 time: 0.028692 Jan 05 18:21:35.513223 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 783/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Wed Jan 5 18:21:35 2022] GET /compute/v2.1/servers/a5a34579-8bcd-4497-8864-7a0197b620ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:38.101344 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8339562f-88cc-4357-ba8e-96bbc49a5303 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Action: 'create', calling method: .version_select at 0x7f7349856430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-144802183", "metadata": {"Type": "work"}}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:38.102837 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-8339562f-88cc-4357-ba8e-96bbc49a5303 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.103638 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-8339562f-88cc-4357-ba8e-96bbc49a5303 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137846 Jan 05 18:21:38.104164 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 831/1614] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jan 5 18:21:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:21:38.113544 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a82b2765-b00a-4566-a0d5-43e512337aad tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Action: 'create', calling method: .version_select at 0x7f73448b3940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-28313343", "metadata": {"Type": "work"}}} {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:38.114963 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-a82b2765-b00a-4566-a0d5-43e512337aad tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.115794 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-a82b2765-b00a-4566-a0d5-43e512337aad tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006361 Jan 05 18:21:38.116292 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 784/1615] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jan 5 18:21:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:21:38.124004 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-67e6ecc3-7d4b-43ce-bfd4-96b6a5559285 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Action: 'create', calling method: .version_select at 0x7f73497ba430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-829863767", "metadata": {"Type": "work"}}} {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 05 18:21:38.125760 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-67e6ecc3-7d4b-43ce-bfd4-96b6a5559285 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.126770 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-67e6ecc3-7d4b-43ce-bfd4-96b6a5559285 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006196 Jan 05 18:21:38.127261 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 832/1616] 10.222.0.26 () {60 vars in 1155 bytes} [Wed Jan 5 18:21:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 05 18:21:38.139622 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fe51398e-4f91-45ed-875d-979463322c55 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Calling method '.version_select at 0x7f73446e13a0>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:38.172793 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-fe51398e-4f91-45ed-875d-979463322c55 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] HTTP exception thrown: Volume tempest-invalid-285032272 could not be found. Jan 05 18:21:38.174335 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-fe51398e-4f91-45ed-875d-979463322c55 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 404 to user: Volume tempest-invalid-285032272 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.175172 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-fe51398e-4f91-45ed-875d-979463322c55 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-285032272" status: 404 len: 98 microversion: 2.1 time: 0.043185 Jan 05 18:21:38.175820 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 785/1617] 10.222.0.26 () {58 vars in 1214 bytes} [Wed Jan 5 18:21:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-285032272 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 05 18:21:38.185531 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-e7da9f03-f4d8-4952-b3c8-64e92ac5da89 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004660 Jan 05 18:21:38.186051 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 833/1618] 10.222.0.26 () {58 vars in 1139 bytes} [Wed Jan 5 18:21:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 05 18:21:38.194507 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-4db562b3-5eae-482b-8e58-896a8126ec30 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003524 Jan 05 18:21:38.195002 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 786/1619] 10.222.0.26 () {58 vars in 1136 bytes} [Wed Jan 5 18:21:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 05 18:21:38.202702 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-77a8700f-3338-4a8b-b318-7744296bedf5 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Calling method '.version_select at 0x7f7349895280>' {{(pid=116428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:38.228664 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.wsgi [None req-77a8700f-3338-4a8b-b318-7744296bedf5 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] HTTP exception thrown: Volume 957734d1-fdc5-40cb-b0e5-55645dbaaead could not be found. Jan 05 18:21:38.229245 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: DEBUG nova.api.openstack.wsgi [None req-77a8700f-3338-4a8b-b318-7744296bedf5 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 404 to user: Volume 957734d1-fdc5-40cb-b0e5-55645dbaaead could not be found. {{(pid=116428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.230355 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO nova.api.openstack.requestlog [None req-77a8700f-3338-4a8b-b318-7744296bedf5 tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/957734d1-fdc5-40cb-b0e5-55645dbaaead" status: 404 len: 109 microversion: 2.1 time: 0.030738 Jan 05 18:21:38.230870 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: [pid: 116428|app: 0|req: 834/1620] 10.222.0.26 () {58 vars in 1247 bytes} [Wed Jan 5 18:21:38 2022] DELETE /compute/v2.1/os-volumes/957734d1-fdc5-40cb-b0e5-55645dbaaead => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 05 18:21:38.240264 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1860290f-817a-461a-a0bf-8d478ab5e26d tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Calling method '.version_select at 0x7f73448ac160>' {{(pid=116429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 05 18:21:38.267013 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.wsgi [None req-1860290f-817a-461a-a0bf-8d478ab5e26d tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] HTTP exception thrown: Volume 7f68639a-121e-4ac1-95d5-11ffc3b2fdd2 could not be found. Jan 05 18:21:38.267636 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: DEBUG nova.api.openstack.wsgi [None req-1860290f-817a-461a-a0bf-8d478ab5e26d tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] Returning 404 to user: Volume 7f68639a-121e-4ac1-95d5-11ffc3b2fdd2 could not be found. {{(pid=116429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 05 18:21:38.268458 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO nova.api.openstack.requestlog [None req-1860290f-817a-461a-a0bf-8d478ab5e26d tempest-VolumesNegativeTest-937547196 tempest-VolumesNegativeTest-937547196-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/7f68639a-121e-4ac1-95d5-11ffc3b2fdd2" status: 404 len: 109 microversion: 2.1 time: 0.031781 Jan 05 18:21:38.268981 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: [pid: 116429|app: 0|req: 787/1621] 10.222.0.26 () {58 vars in 1244 bytes} [Wed Jan 5 18:21:38 2022] GET /compute/v2.1/os-volumes/7f68639a-121e-4ac1-95d5-11ffc3b2fdd2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 05 18:21:45.579998 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:21:45.580577 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:23:28.726964 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:23:28.729634 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:23:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:23:35.561637 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:23:35.562137 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:23:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:25:05.589806 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:25:05.590551 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:25:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:26:48.736775 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:26:48.737381 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:26:55.569934 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:26:55.570535 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:26:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:27:07.824267 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:27:07.824915 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:27:11.147225 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:27:11.147901 dv-cinder-xena-3-iscsi devstack@n-api.service[116428]: Wed Jan 5 18:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:27:24.050957 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:27:24.051751 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:27:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 05 18:28:25.599838 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 05 18:28:25.600648 dv-cinder-xena-3-iscsi devstack@n-api.service[116429]: Wed Jan 5 18:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!